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Preface 


This is a multipurpose text. When taken in full, including the “starred” sec- 
tions, it is a graduate course covering differentiation on normed spaces and 
integration with respect to complex and vector-valued measures. The starred 
sections may be omitted without loss of continuity, however, for a junior or 
senior course. One also has the option of limiting all to E”, or taking Riemann 
integration before Lebesgue theory (we call it the “limited approach”). The 
proofs and definitions are so chosen that they are as simple in the general case 
as in the more special cases. In a nutshell, the basic ideas of measure theory 
are given in Chapter 7, §$1 and 2. Not much more is needed for the “limited 
approach.” 

In Chapter 6 (Differentiation), we have endeavored to present a modern 
theory, without losing contact with the classical terminology and notation. 
(Otherwise, the student is unable to read classical texts after have been taught 
the “elegant” modern theory.) This is why we prefer to define derivatives as 
in classical analysis, i.e., as numbers or vectors, not as linear mappings. The 
latter are used to define a modern version of differentials. 

In Chapter 9, we single out those calculus topics (e.g., improper integrals) 
that are best treated in the context of Lebesgue theory. 

Our principle is to keep the exposition more general whenever the general 
case can be handled as simply as the special ones (the degree of the desired 
specialization is left to the instructor). Often this even simplifies matters— 
for example, by considering normed spaces instead of E” only, one avoids 
cumbersome coordinate techniques. Doing so also makes the text more flexible. 


Publisher’s Notes 


Text passages in blue are hyperlinks to other parts of the text. 
Several annotations are used throughout this book: 


* This symbol marks material that can be omitted at first reading. 


=> This symbol marks exercises that are of particular importance. 


About the Author 


Elias Zakon was born in Russia under the czar in 1908, and he was swept 
along in the turbulence of the great events of twentieth-century Europe. 

Zakon studied mathematics and law in Germany and Poland, and later he 
joined his father’s law practice in Poland. Fleeing the approach of the German 
Army in 1941, he took his family to Barnaul, Siberia, where, with the rest of 
the populace, they endured five years of hardship. The Leningrad Institute of 
Technology was also evacuated to Barnaul upon the siege of Leningrad, and 
there Zakon met the mathematician I. P. Natanson; with Natanson’s encour- 
agement, Zakon again took up his studies and research in mathematics. 

Zakon and his family spent the years from 1946 to 1949 in a refugee camp 
in Salzburg, Austria, where he taught himself Hebrew, one of the six or seven 
languages in which he became fluent. In 1949, he took his family to the newly 
created state of Israel and he taught at the Technion in Haifa until 1956. In 
Israel he published his first research papers in logic and analysis. 

Throughout his life, Zakon maintained a love of music, art, politics, history, 
law, and especially chess; it was in Israel that he achieved the rank of chess 
master. 

In 1956, Zakon moved to Canada. As a research fellow at the University of 
Toronto, he worked with Abraham Robinson. In 1957, he joined the mathemat- 
ics faculty at the University of Windsor, where the first degrees in the newly 
established Honours program in Mathematics were awarded in 1960. While 
at Windsor, he continued publishing his research results in logic and analysis. 
In this post-McCarthy era, he often had as his house-guest the prolific and 
eccentric mathematician Paul Erdés, who was then banned from the United 
States for his political views. Erdés would speak at the University of Windsor, 
where mathematicians from the University of Michigan and other American 
universities would gather to hear him and to discuss mathematics. 

While at Windsor, Zakon developed three volumes on mathematical analysis, 
which were bound and distributed to students. His goal was to introduce 
rigorous material as early as possible; later courses could then rely on this 
material. We are publishing here the latest complete version of the last of 
these volumes, which was used in a two-semester class required of all Honours 
Mathematics students at Windsor. 


Chapter 6 


Differentiation on #” and Other 
Normed Linear Spaces 


81. Directional and Partial Derivatives 


In Chapter 5 we considered functions f: E! — E of one real variable. 


Now we take up functions f: E’ — E where both E’ and E are normed 


spaces. 


The scalar field of both is always assumed the same: E' or C (the complex 
field). The case FE = E* is excluded here; thus all is assumed finite. 


We mostly use arrowed letters p,q,...,Z,y, 7 for vectors in the domain space 
E", and nonarrowed letters for those in F and for scalars. 

As before, we adopt the convention that f is defined on all of E’, with 
f(£) = 0 if not defined otherwise. 

Note that, if @ € EL’, one can express any point 7 € E’ as 


=p + tt, 
with t € E' and w@ a unit vector. For if £ 4 p, set 
= |#— pl and d= 1(¢ 9); 
and if z = p, set t = 0, and any wu will do. We often use the notation 
#=Az=2#-p=tid (te E', Hae EB’). 
First of all, we generalize Definition 1 in Chapter 5, 81. 
Definition 1. 


Given f: E’ > E and p,a € E’ (@ 4 0), we define the directional deriva- 
tive of f along & (or t-directed derivative of f) at p by 


(1 Def (B) = lim = [F('+ ta) ~ f(D) 


1 We now presuppose §§9-12 of Chapter 3, including the “starred” parts. 


2 Chapter 6. Differentiation on E” and Other Normed Linear Spaces 


if this limit exists in F (finite). 
We also define the w-directed derived function, 
Def: E' — E, 


as follows. For any p € E’, 


ee ere eee Mili eRe ofa 2 
papi = | nelle +) Ft if this limit exists, 


0 otherwise. 


Thus Dzf is always defined, but the name derivative is used only if the 
limit (1) exists (finite). If it exists for each p in a set B C E’, we call Dgf (in 
classical notation Of /Ot) the t-directed derivative of f on B. 

Note that, as t — 0, % tends to p over the line # = 7+ tu. Thus Dz f(p) can 
be treated as a relative limit over that line. Observe that it depends on both 
the direction and the length of uw. Indeed, we have the following result. 


Corollary 1. Given f: E' > E, i 40, and a scalar s £0, we have 
Dsaf = sDaf. 

Moreover, Dsaf(p) is a genuine derivative iff Dzf(p) is. 

Proof. Set t = s0 in (1) to get 


sDu:f(B) = him FU (+ Osi) ~ f()] = Deu). 


In particular, taking s = 1/|d|, we have 


|st| = lel = 1 and Dif = Spe 
|u| 8 
Thus all reduces to the case Dz f, where v = su is a unit vector. This device, 
called normalization, is often used, but actually it does not simplify matters. 
If E’ = E” (C”), then f is a function of n scalar variables x, (k = 1,...,n) 
and E’ has the n basic unit vectors é;,. This example leads us to the following 
definition. 


Definition 2. 
If in formula (1), E’ = E” (C”) and w@ = &, for a fixed k < n, we call 
Daf the partially derived function for f, with respect to x, denoted 


of 
Dif or Oxy’ 
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and the limit (1) is called the partial derivative of f at p, with respect to 
x;,, denoted 
6) Of 
D — —— . 
Lf), ot 5— FH), or S| 
If it exists for all p € B, we call Df the partial derivative (briefly, 
partial) of f on B, with respect to xx. 
In any case, the derived functions D,f (k = 1,...,n) are always de- 
fined on all of E” (C”). 
If E’ = E> (C3), we often write x,y, z for x1, 72,73, and 
Of Of Of 2 
ea ae, Sot) k = 1,2,3). 
Note 1. If E’ = E', scalars are also “vectors,” and D,f coincides with f’ 
as defined in Chapter 5, §1 (except where f’ = +00). Explain! 


Note 2. As we have observed, the u-directed derivative (1) is obtained by 
keeping Z on the line X = p+ tu. 

If w = &, the line is parallel to the kth axis; so all coordinates of 7, except 
LE, remain fixed (x; = pi,i # k), and f behaves like a function of one variable, 
x;. Thus we can compute D;f by the usual rules of differentiation, treating 
all x; (i 4k) as constants and x, as the only variable. 

For example, let f(x,y) = x?y. Then 

of of 


oy = - Ones en 
Ae Di f(x,y) = 2xy and a Diigo) a2 


Note 3. More generally, given p and & ¥ 0, set 
A(t) = f(p@t+ti), te E'. 
Then h(0) = f(); so 


Daf (B) = linn =f ta) — FD) 


= |j h(t) = h(0) 
> £50 t—O 
=1'(0) 


if the limit exists. Thus all reduces to a function h of one real variable. 

For functions f: E' — E, the existence of a finite derivative (“differentia- 
bility”) at p implies continuity at p (Theorem 1 of Chapter 5, §1). But in the 
general case, f: E’ > E, this may fail even if Daf (p) exists for all 4 0. 


? Similarly in the case E’ = E? (C7). 
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Examples. 
(a) Define f: E? — E! by 
uty 
f(x,y) pape f (0,0) 


Fix a unit vector @ = (u1, ug) in E?. Let p= (0,0). To find Dgf(p), use 
the h of Note 3: 


turu 
i 5) if U2 #0), 


h(t) = f(pt tu) = f(td) = f(tur, tug) = Pee 


and h = 0 if uw2 = 0. Hence 
ue 
Def (p) = h'(0) = + if ug £0, 
U2 


and h/(0) = Oif ug = 0. Thus D;(0) exists for all @. Yet f is discontinuous 
at 0 (see Problem 9 in Chapter 4, §3). 

(b) Let 

z+y ifzy=0, 


f(x,y) =| 


Then f(x,y) = a on the x-axis; so D, f (0,0) = 1. 
Similarly, D2 f(0,0) = 1. Thus both partials exist at 0. 


Yet f is discontinuous at 0 (even relatively so) over any line y = ax 
(a £ 0). For on that line, f(x,y) = 1 if (z,y) ¥ (0,0); so f(x,y) — 1; 
but f(0,0) =0+0=0. 

Thus continuity at 0 fails. (But see Theorem 1 below!) 


1 otherwise. 


Hence, if differentiability 7s to imply continuity, it must be defined in a 
stronger manner. We do it in §3. For now, we prove only some theorems on 
partial and directional derivatives, based on those of Chapter 5. 


Theorem 1. Jf f: E’ — E has a w-directed derivative at p € E’, then f is 
relatively continuous at p over the line 


¢=pitd (OAUEF’. 


Proof. Set h(t) = f(p+tu), t€ E’. 
By Note 3, our assumption implies that h (a function on E') is differentiable 
at 0. 


By Theorem 1 in Chapter 5, §1, then, h is continuous at 0; so 
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Le., 
lim f(P-+ ti) = FB). 
But this means that f(#) — f(p) as € — Pp over the line ¥ = p+ tu, for, on 
that line, # = p+ tu. 
Thus, indeed, f is relatively continuous at p, as stated. 


Note that we actually used the substitution # = p+ tu. This is admissi- 
ble since the dependence between x and ¢ is one-to-tone (Corollary 2(iii) of 
Chapter 4, §2). Why? 

Theorem 2. Let E’3 i= G—7jp, w¢0. 

If f: E' = E is relatively continuous on the segment I = Lip, q| and has a 

u-directed derivative on I — Q (Q countable), then 


(2) If) — f@)| <sup|Daf(@)|, ®Eel—Q. 


Proof. Set again h(t) = f(p+ tu) and g(t) = p+ tu. 

Then h = f og, and g is continuous on E'. (Why?) 

As f is relatively continuous on I = L{p, qj, so is h = f og on the interval 
J = [0,1] c E' (cf. Chapter 4, §8, Example (1)). 

Now fix to) € J. If % = p+tou € I — Q, our assumptions imply the 
existence of 


= lim <[f(@+ tow + tt) — f(p+ tow)] 
= lim —[h(to + t) — h(to)] 


=h'(to). (Explain!) 


This can fail for at most a countable set Q’ of points to € J (those for which 
Ho € Q). 
Thus h is differentiable on J — Q’; and so, by Corollary 1 in Chapter 5, 84, 


|n(1) — R(0)| < sup |h’(t)| = sup |Dzf(#)]. 
te J—Q! zEI-Q 


Now as A(1) = f(#+ a) = f(@ and h(0) = f(p), formula (2) follows. 


Theorem 3. If in Theorem 2, E = E! and if f has a w-directed derivative at 
least on the open line segment L(p, q), then 


(3) f(Q) — fe) = Dif (o) 
for some %o € L(p,q). 
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The proof is as in Theorem 2, based on Corollary 3 in Chapter 5, §2 (instead 
of Corollary 1 in Chapter 5, §4). 
Theorems 2 and 3 are often used in “normalized” form, as follows. 


Corollary 2. If in Theorems 2 and 3, we set 


r= |i = |¢— a #0 and v= “a, 
then forniuilas: (2) and (3) caw be writien as 
(2’) lf(Q) —f@) < |¢—-p] sup|Dsf(z)|, LET—Q, 
and 
(3') f(D — f@) = |¢- Pl Def (Zo) 


for some %o € L(p,q). 
For by Corollary 1, 


Dif =rDef =\¢- DB Def; 
so (2’) and (3’) follow. 


Problems on Directional and Partial Derivatives 


1. Complete all missing details in the proof of Theorems 1 to 3 and Corol- 
laries 1 and 2. 

2. Complete all details in Examples (a) and (b). Find D, f(p) and D2f (p) 
also for p 4 0. Do Example (b) in two ways: (i) use Note 3; (ii) use 
Definition 2 only. 

3. In Examples (a) and (b) describe Dzf: E? — E'. Compute it for 
Tica lle ears 

In (b), show that f has no directional derivatives Dz f(p) except if 
% || €; or w || 2. Give two proofs: (i) use Theorem 1; (ii) use definitions 
only. 

4. Prove that if f: E”(C") — E has a zero partial derivative, D, f = 0, 
on a convex set A, then f(Z) does not depend on xz, for # € A. (Use 
Theorems 1 and 2.) 

5. Describe Dif and D2f on the various parts of E?, and discuss the 
relative continuity of f over lines through 0, given that f(x,y) equals: 


i eal er ii) the integral part of x + y; 
x? + y? 
L, B22 ye 
ill a test iv) ry—>—s; 
ai) O) sey 


(v) sin(y cos a (vi) as 
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(Set f =0 wherever the formula makes no sense.) 


=>6. Prove that if f: E’ — E' has a local maximum or minimum at p € E’, 
then Dz f(p) = 0 for every vector @ #0 in E’. 
[Hint: Use Note 3, then Corollary 1 in Chapter 5, §2.] 


7. State and prove the Finite Increments Law (Theorem 1 of Chapter 5, 
84) for directional derivatives. 
[Hint: Imitate Theorem 2 using two auxiliary functions, h and k.] 


8. State and prove Theorems 4 and 5 of Chapter 5, 81, for directional 
derivatives. 
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For an adequate definition of differentiability, we need the notion of a linear 
map. Below, E’, E”, and E denote normed spaces over the same scalar field, 
Bt or. 


Definition 1. 


A function f: E’ — E is a linear map if and only if for all 7,4 € E’ and 
scalars a, b 


(1) fax + by) = af (Z) + bf(¥); 
equivalently, iff for all such #, y, and a 
f(E+Y) = f(x) + fly) and flax) = af(z). (Verify!) 


If E = E’, such a map is also called a linear operator. 
If the range space E is the scalar field of E’, (i.e., E+ or C,) the linear 
map f is also called a (real or complex) linear functional on E’. 


Note 1. Induction extends formula (1) to any “linear combinations”: 


(2) 3 ats) = S asf) 


for all #; € E’ and scalars a;. 
Briefly: A linear map f preserves linear combinations. 


Note 2. Taking a = b = 0 in (1), we obtain f(0) = 0 if f is linear. 
Examples. 
(a) Let BE’ = E” (C”). Fix a vector U = (v1,...,Un) in EB’ and set 
(VZEE') fe) =2-0 
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(inner product; see Chapter 3, §§1-3 and 89). 
Then 


so f is linear. Note that if E’ = E”, then by definition, 


If, however, E’ = C”, then 


II 
Me 
8 
> 
el] 
> 
II 
Me 
iol] 
> 
8 
= 


f(Z)=2-0 


where t; is the conjugate of the complex number vz. 
By Theorem 3 in Chapter 4, §3, f is continuous (a polynomial!). 
Moreover, f(%) = %-@ is a scalar (in E' or C). Thus the range of f 
lies in the scalar field of E’; so f is a linear functional on E’. 


Let J = [0,1]. Let E’ be the set of all functions u: I — E that are of 
class CD® (Chapter 5, §6) on J, hence bounded there (Theorem 2 of 
Chapter 4, §8). 

As in Example (C) in Chapter 3, §10, E” is a normed linear space, with 
norm 


[|u|] = sup |u(x)]. 
cel 


Here each function u € E’ is treated as a single “point” in E’. The 
distance between two such points, u and v, equals ||u — v||, by definition. 

Now define a map D on E’ by setting D(u) = u (derivative of u on J). 
As every u € E’ is of class CD™, so is u’. 

Thus D(u) = u’ € E’, and so D: E’ => E’ is a linear operator. (Its 
linearity follows from Theorem 4 in Chapter 5, §1.) 
Let again I = [0,1]. Let E’ be the set of all functions u: I — E that are 
bounded and have antiderivatives (Chapter 5, §5) on J. With norm ||u|| 
as in Example (b), E£” is a normed linear space. 

Now define ¢: E’ > E by 


o(u) = [uw 


with fu as in Chapter 5, §5. (Recall that f> u is an element of E if 
u: I > E.) By Corollary 1 in Chapter 5, §5, ¢ is a linear map of E’ into 
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E. (Why?) 
(d) The zero map f =0 on E’ is always linear. (Why?) 

Theorem 1. A linear map fi EF — E is continuous (even uniformly so) on 
all of E’ iff it is continuous at 0; equivalently, iff there is a real c > 0 such that 
(VEE E) |f(2)| < ela]. 

(We call this property linear boundedness.) 


Proof. Assume that f is continuous at 0. Then, given € > 0, there is 6 > 0 
such that 
f(z) — F(0)| = |f@)| Se 
whenever |Z — 0| = |z| < 6. 
Now, for any 40, we surely have 


O# 6 
——|=-= <4. 
sa a 
Hence 
= 6x 
wad) |1(ga)|<e 
Iz 
or, by linearity, 
é e 
aa! = 
Le., 
Shy ets 
y@l< Sia, 
By Note 2, this also holds if ¢ = 0. 
Thus, taking c = 2¢/6, we obtain 
(3) (V@eE") f(#) <c|z| (linear boundedness). 


Now assume (3). Then 
(Va, GEE) |f(@-H| <c#-g; 
or, by linearity, 
(4) (V@GCE) |f@)-f@| <de@-H. 


Hence f is uniformly continuous (given ¢ > 0, take 6 = e/c). This, in turn, 
implies continuity at 0; so all conditions are equivalent, as claimed. 


1 This is the so-called uniform Lipschitz condition. 
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A linear map need not be continuous.? But, for E” and C”, we have the 
following result. 
Theorem 2. 
(i) Any linear map on E” or C” is uniformly continuous. 
(ii) Every linear functional on E” (C") has the form 
f(@)=#-0 (dot product) 
for some unique vector 0 € E” (C”), dependent on f only. 


Proof. Suppose f: E” — E is linear; so f preserves linear combinations. 
But every < € E” is such a combination, 


—— ye xpéx (Theorem 2 in Chapter 3, §§1-3). 


Here the function values f(é,) are fixed vectors in the range space F, say, 
f(&&) =v, € E, 
so that 
(5) FB) => 0 wef) => teve, ve EE. 
k=1 k=1 


Thus f is a polynomial in n real variables x, hence continuous (even uniformly 
so, by Theorem 1). 

In particular, if E = E? (ie., f is a linear functional) then all vj, in (5) are 
real numbers; so they form a vector 


v= (U1,--+5Uk) in E”, 


and (5) can be written as 
SQ Sao". 
The vector v is unique. For suppose there are two vectors, u and Uv, such that 
VEE”) FQ reva rou, 
Then 
(VZEER") #£-W-ad)=0. 


2 See Problem 2(ii) below. 
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By Problem 10 of Chapter 3, §§1-3, this yields ¢-— ¢ = 0, or ¢ = @. This 
completes the proof for E = E”. 

It is analogous for C”; only in (ii) the vg, are complex and one has to replace 
them by their conjugates 0, when forming the vector @ to obtain f(Z) = @- 7%. 
Thus all is proved. 


Note 3. Formula (5) shows that a linear map f: E” (C") — E is uniquely 
determined by the n function values vz = f(&,). 
If further FE = E™ (C™), the vectors vz, are m-tuples of scalars, 


UK = (Vik, Ss oiee 5 Una): 


We often write such vectors vertically, as the n “columns” in an array of m 
“rows” and n “columns”: 


Vi1 V12 Vin 

V21 V22 V2n 
(6) 

Um1 Um2 +++ Umn 


Formally, (6) is a double sequence of mn terms, called an m x n matriz. We 
denote it by [f] = (vjx), where for k = 1,2,...,n, 
f(&) = UR = (Vik, Bete Opts I 


Thus linear maps f: E” — E™ (or f: C" — C™) correspond one-to-one to 
their matrices |f]. 
The easy proof of Corollaries 1 to 3 below is left to the reader. 


Corollary 1. If f,g: E’ — E are linear, so is 
h=af +g 


for any scalars a, b. 
If further E’ = E” (C™) and E = E™ (C™), with [f] = (viz) and [g] = (wix), 
then 
[h] = (aviz + bwix)- 


Corollary 2. A map f: E"(C”) — E is linear iff 
f(@) = Do vee, 
k=1 


where vz, = f(&). 


Hint: For the “if,” use Corollary 1. For the “only if,” use formula (5) above. 
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Corollary 3. If f: E’ = E” and g: E" — E are linear, so is the composite 
h= go f. 
Our next theorem deals with the matrix of the composite linear map go f. 


Theorem 3. Let f: E’ = E” and gq: E"” = E be linear, with 
Bah Cos jh (G"), aia Lah (GC), 
If [f] = (viz) and [g] = (wi), then 
[h] = [9° f] = (zx), 


where 


7 i Wiitipy JH 1,2)... 7% BH 1, 2;...5n 
j j 
i=l 


Proof. Denote the basic unit vectors in E’ by 


eae 
those in E” by 
1; bees 
and those in EF’ by 
€1,---,€r 
Then for k = 1,2,...,n, 
fk) = Ue = So vine! and h(e,) = Sine 
j= j=l 
and for 7 = 1 mM, 
g(e;) = S > wyie; 
j=l 
Also 
a(ek) = oC Fles)) = 703 vel) = > ragtet Lg 6 wy). 
i=1 i=1 j=l 
Thus 


(el) = 3 2jxey = (2 wy). 


But the representation in terms of the e; is unique (Theorem 2 in Chapter 3, 
§§1-3), so, equating coefficients, we get (7). 
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Note 4. Observe that z;, is obtained, so to say, by “dot-multiplying” the 
jth row of [g] (an r x m matrix) by the kth column of [f] (an m x n matrix). 


It is natural to set 
IIIf] = [9° fl, 
or 
(wyi) (Vik) = (25x), 
with z;, as in (7). 
Caution. Matrix multiplication, so defined, is not commutative. 
Definition 2. 


The set of all continuous linear maps f: E’ — E (for fixed E’ and E) is 
denoted L(E’, E). 

If E = E’, we write L(£) instead. 

For each f in L(E’, E), we define its norm by 


fll = sup |f(2)/° 
|Z|<1 
Note that || f|| <+oo, by Theorem 1. 
Theorem 4. L(E’, E) is a normed linear space under the norm defined above 


and under the usual operations on functions, as in Corollary 1. 


Proof. Corollary 1 easily implies that L(E’, F) is a vector space. We now 
show that || - || is a genuine norm. 
The triangle law, 


[f+ gl] < [Fl + ligt 


follows exactly as in Example (C) of Chapter 3, §10. (Verify!) 

Also, by Problem 5 in Chapter 2, §§88-9, sup |af(Z)| = |a| sup | f(Z)|. Hence 
laf || = |al|| f|| for any scalar a. 

As noted above, 0 < || f|| < +00. 

It remains to show that || f|| = 0 iff f is the zero map. If 


II fll = sup |f(@)| = 0, 
|z<1 
then | f(Z)| = 0 when |z| < 1. Hence, if # 4 0, 


i 1 
Ss = aa bE) = 0. 
i) |z| 
As f(0) =0, we have f(#) =0 for all € E’. 
Thus || f|| = 0 implies f = 0, and the converse is clear. Thus all is proved. 


3 Equivalently, || f|| = suPZ ZG | f (Z)|/|Z|; see Note 5 below. 
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Note 5. A similar proof, via f (iz) and properties of lub, shows that 
f(@) | 
Z| 


(VEE E’) |f()| <I fllle. 
It also follows that || f|| is the least real c such that 
(VGEE’) |f(#)| < ela]. 


fll = sup| 
EA0 


and 


Verify. (See Problem 3’.) 
As in any normed space, we define distances in L(E’, F) by 


making it a metric space; so we may speak of convergence, limits, etc., in it. 
Corollary 4. If f ¢ L(E",E”) and g € L(E”,E), then 
igo fll < llgll Ifill. 
Proof. By Note 5, 
(VEE EB) |g(F(Z))| < IlglF@I < Ioll FIA. 


Hence " 
weed) [EDO < iol it 
and so 
oll Ls = sup ESB — Igo fh 
#40 


Problems on Linear Maps and Matrices 
1. Verify Note 1 and the equivalence of the two statements in Definition 1. 
2. In Examples (b) and (c) show that 
fn — f (uniformly) on I iff || fn — f || - 0, 
ie., fn — f in E'. 
[Hint: Use Theorem 1 in Chapter 4, §2.] 
Hence deduce the following. 


(i) If E is complete, then the map ¢ in Example (c) is continuous. 
[Hint: Use Theorem 2 of Chapter 5, §9, and Theorem 1 in Chapter 4, §12.] 


(ii) The map D of Example (b) is not continuous. 
[Hint: Use Problem 3 in Chapter 5, §9.] 
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3. 


3/ 


Prove Corollaries 1 to 3. 


Show that 


[fll = sup |f(@)| = sup |f(#)| = sup 
|el<1 | 


z\|=1 EAO || 


[Hint: From linearity of f deduce that |f(#)| > |f(cx)| if |c| < 1. Hence one may 
disregard vectors of length < 1 when computing sup |f(#)|. Why?] 


. Find the matrices [f], [g], [A], [k], and the defining formulas for the 


linear maps fi Soe Gg aE eae ee Sa ea 
(i) f(4) =3, f(@2) = —2; 


( 
(€1) = (2,2), h(é) = (0,—2), h(e€3) = (1,0), hes) = (-1, 1); 
y= 0.1 =1): 


. In Problem 4, use Note 4 to find the product matrices [k] [f], [g] [A], 


[f] [A], and [Ah] [g]. Hence obtain the defining formulas for ko f, gok, 
foh, and hog. 


. For m x n-matrices (with m and n fixed) define addition and multipli- 


cation by scalars as follows: 
alf] + b[g] = laf + bg] if f,g € LUE”, E™) (or L(C”,C™)). 


Show that these matrices form a vector space over E' (or C). 


. With matrix addition as in Problem 6, and multiplication as in Note 4, 


show that all n x n-matrices form a noncommutative ring with unity, 
i.e., satisfy the field axioms (Chapter 2, §§1—4) except the commutativity 
of multiplication and existence of multiplicative inverses (give counterex- 
amples!). 

Which is the “unity” matrix? 


. Let f: E’ > E be linear. Prove the following statements. 


(i) The derivative Dif (pf) exists and equals f(w) for every p,u € E’ 
(a #0); 


(ii) f is relatively continuous on any line in E’ (use Theorem 1 in §1); 


(iii) f carries any such line into a line in E. 


. Let g: E” — E be linear. Prove that if some f: E’ — E” has a t- 


directed derivative at pf € E’, so has h = gof, and Dzh(p) = g(Def(p)). 
[Hint: Use Problem 8.] 
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A set A in a vector space V (A C V) is said to be linear (or a linear 
subspace of V) iff a + by € A for any Z,¥ € A and any scalars a,b. 
Prove the following. 


(i) Any such A is itself a vector space. 


(ii) If f: E’ — E is a linear map and A is linear in E” (respectively, 
in E), so is f[A] in E (respectively, so is f~+[A] in E’). 
A set A in a vector space V is called the span of aset B C A (A = sp(B)) 


iff A consists of all linear combinations of vectors from B. We then also 
say that B spans A. 


Prove the following: 
(i) A =sp(B) is the smallest linear subspace of V that contains B. 
(ii) If f: V — E is linear and A = sp(B), then f[A] = sp(f[B]) in E. 


A set B = {%1, £2,...,£,} in a vector space V is called a basis iff each 
ve V has a unique representation as 


n 
v= ) a,x; 
i=1 


for some scalars a;. If so, the number n of the vectors in B is called the 
dimension of V, and V is said to be n-dimensional. Examples of such 
spaces are E” and C” (the & form a basis!). 
(i) Show that B is a basis iff it spans V (see Problem 11) and its 
elements 2; are linearly independent, i.e., 


n 
) a;£; = O iff all a; vanish. 
i=l 


(ii) If E’ is finite-dimensional, all linear maps on E’ are uniformly 
continuous. (See also Problems 3 and 4 of 86.) 


Prove that if f: E1 — E is continuous and (Vz, y € E') 


fle+y) = f(a) + fy), 


then f is linear; so, by Corollary 2, f(a) = vx where v = f(1). 

[Hint: Show that f(ax) = af(x); first fora = 1,2,... (note: ne =x+a4---+a2, 
n terms); then for rational a = m/n; then fora =0 anda=—1. Anya€ Elisa 
limit of rationals; so use continuity and Theorem 1 in Chapter 4, §2.] 
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As we know, a function f: E! — E (on E') is differentiable at p € E' iff, with 
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Af = f(«) — f(p) and Ax = x — p, 
Af 
! ay As. : 
p= lim Ag exists (finite). 


Setting Ax = x—-p=t, Af = f(p+t) — f(p), and f’(p) = v, we may write 
this equation as 


lim al — v| = = 0, 
t—0| ¢ 
or 
(1) lim = |f(p + t) — f(p) — vt] = 0. 
#0 |t| 


Now define a map ¢: E! — E by o(t) =tv, v= f'(p) € E. 
Then ¢ is linear and continuous, i.e., 6 € L(E', E); so by Corollary 2 in §2, 
we may express (1) as follows: there is a map ¢ € L(E', E) such that 


lim TIAL — o(0)| = 0. 


We adopt this as a definition in the general case, f: E’ — E, as well. 
Definition 1. 


A function f: E’ — E (where E’ and E are normed spaces over the same 
scalar field) is said to be differentiable at a point p € E’ iff there is a map 


¢€ L(E’"_,E) 
such that 
lim = |Af — $(B| =0; 
6 |é] 
that is, 
(2) lim —[f(@+ 8) — f@) — 6] =0. 
i0 |e] 


As we show below, ¢ is unique (for a fixed ), if it exists. 
We call ¢ the differential of f at p, briefly denoted df. As it depends 
on jp, we also write df(p;t) for df(t) and df(p, -) for df. 


Some authors write f’(j) for df(p, -) and call it the derivative at p, but we 
shall not do this (see Preface). Following M. Spivak, however, we shall use 
“I f’(p)|” for its matriz, as follows. 

Definition 2. 
If E’ = BE” (C”) and EF = E™(C™), and f: E’ — E is differentiable at 


Dp, we set 
[f'(P)] = [dF (B, - )] 
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and call it the Jacobian matrix of f at p. 


Note 1. In Chapter 5, 86, we did not define df as a mapping. However, if 
E’ = E', the function value 


df (p;t) = vt = f'(p)Ax 
is as in Chapter 5, 86. 


Also, [f’(p)] is a 1x 1 matrix with single term f’(p). (Why?) This motivated 
Definition 2. 


Theorem 1 (uniqueness of df). If f: E’ — E is differentiable at p, then the 
map @ described in Definition 1 is unique (dependent on f and p only). 


Proof. — there is another linear map g: E’ — E such that 


(3) lim [f+ 8) — F@) ~ 9@] = lim [Af — g(B)] = 0. 


i6 v7 via 


Let h = ¢— g. By Corollary 1 in §2, h is linear. 
Also, by the triangle law, 


lA(E)| = ld) — 9@)| S IAF -— 61+ IAS — oO. 
Hence, dividing by |¢], 


(=) |- MBL < BIAS - a1 + las — a 


By (3) and (2), the right side expressions tend to 0 as f > 0. Thus 


ima) =o 


This remains valid also if f > 0 over any line through 0, so that ¢/|t] remains 
constant, say t/|t] = @, where @ is an arbitrary (but fixed) unit vector. 
Then 


> 


(a) = a 


is constant; so it can tend to 0 only if it equals 0, so h(t) = O for any unit 
vector w. 


Since any Z € E’ can be written as % = |Z| d, linearity yields 
h(a) = |z| hea) = 0. 


Thus h = ¢—g =0 on E’, and so ¢ = g after all, proving the uniqueness 
of ¢. 
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Theorem 2. If f is differentiable at p, then 
(i) f ts continuous at p; 


(ii) for any @ 40, f has the t-directed derivative 
Dif (P) = df (B; a). 


Proof. By assumption, formula (2) holds for ¢ = df(j, -). 


Thus, given ¢ > 0, there is 6 > 0 such that, setting Af = f(~+t) — f(p) 
we have 


(4) alot — (t)| < ¢ whenever 0 < |t] < 6; 


or, by the triangle law, 
(5) IAF] <|AF- e@1+14O] sel +loO], 0< | <4 


Now, by Definition 1, ¢ is linear and continuous; so 
tim |6@)| = |6(0)| = 0. 


Thus, making f — 0 in (5), with « fixed, we get 
lim |Af| = 0. 
t—0 


As f is just another notation for Az = #— 7, this proves assertion (i). 
Next, fix any 7 #0 in E’, and substitute td for ¢ in (4). 
In other words, t is a real variable, 0 < t < 6/|d|, so that t = td satisfies 
O< i <4. 
Multiplying by |d|, we use the linearity of ¢ to get 
au ef) | _ | f+ ta) — f(P) 
|= [FP -e@|=|=8 


o(u)}. 


e|u| > 
As € is cote we have 


(it) = lim “[F@+ tal) ~ f(9)] 


t0 ¢ 
But this is simply Dzf(p), by Definition 1 in §1. 
Thus Di f(p) = e(u) = df(p; uz), proving (ii). 


Note 2. If E’ = E” (C"), Theorem 2(ii) shows that if f is differentiable at 
p, it has the n partials 


Def (po) = df (Ge), B= 1,...4% 
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But the converse fails: the existence of the D; f(j@) does not even imply con- 
tinuity, let alone differentiability (see §1). Moreover, we have the following 
result. 


Corollary 1. [f E’ = E" (C") and if f: E' — E is differentiable at p, then 
(6) df (Bf) = YH DusD =a 


where t = (t1,...,tn). 
Proof. By definition, ¢ = df(j, -) is a linear map for a fixed p. 

If E’ = E” or C”, we may use formula (3) of §2, replacing f and Z by ¢ and 
t, and get 


o(E) = df (Bit) = D0 tedf (Pe) = Yo teDe f(D) 
k=l 


k=1 


by Note 2 


Note 3. In classical notation, one writes Ax, or dx, for t, in (6). Thus, 
omitting p and t, formula (6) is often written as 


od of of 

/ 

=— —- . ——dxp. 
(6") df = ar ae algerie Den as 

In particular, if n = 3, we write x,y, z for 71, 22,73. This yields 
w a= aa hays Oa 


(a familiar calculus formula). 


Note 4. If the range space E in Corollary 1 is E'(C), then the D;f(p) 
form an n-tuple of scalars, i.e., a vector in E” (C”). 
In case f: E” — E', we denote it by 


V(b) = (Dif @),--- Daf) = S— ee Def (W). 
In case f: C” — C, we replace the D;, f(p) by their conjugates D;, f(@) and set 
= S>& Def (P) 
k=1 


The vector V f() is called the gradient of f (“grad f”) at p. 
From (6) we obtain 


(7) df (p:t) = S> teDef (P) =t- VF) 
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(dot product of t by Vf(p)), provided f: BE” — E' (or f: C” > C) is differ- 
entiable at p. 
This leads us to the following result. 
Corollary 2. A function f: E” — E' (or f: C" = C) is differentiable at p 
uff 
ee gh 
(8) lim FU+ 5 — FH) ~F- a} =0 


t—0 | 


for some v € E” (C™). 

In this case, necessarily 6 = Vf (p) and t-% = df (pit), t€ E” (C”). 
Proof. If f is differentiable at p, we may set ¢ = df(p,-) and = Vf(p). 

Then by (7), 

o(t) = df (Bt) = 

so by Definition 1, (8) results. 

Conversely, if some @ satisfies (8), set d(f) = f-%. Then (8) implies (2), and 
@ is linear and continuous. 

Thus by definition, f is differentiable at ; so (7) holds. 

Also, ¢ is a linear functional on E” (C"). By Theorem 2(ii) in §2, the @ in 
o(t) =t- @ is unique, as is ¢. 

Thus by (7), ¢ = Vf(p) necessarily. 


St 


Corollary 3 (law of the mean). If f: E" — E' (real) is relatively continuous 
on a closed segment L\p,q|, p 4 , and differentiable on L(p,q), then 


(9) f(D — fp) = (¢- DB) - VF (0) 
for some £o € L(p,q). 
Proof. Let 


By (7) and Theorem 2(ii), 
Desf (@) = df (&;v) =0- V f(z) 
fora @ 0G). ‘Thus by formula (3°) of Complain G1, 
fQ — fp) = rDsf(fo) = rv- Vf(o) = (¢- P)- VF (Zo) 


for some Zp € L(p, q). 


As we know, the mere existence of partials does not imply differentiability. 
But the existence of continuous partials does. Indeed, we have the following 
theorem. 
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Theorem 3. Let E’ = E”(C”). 

If f: E' = E has the partial derivatives D,f (k = 1,...,n) on all of an 
open set A C E’, and if the Dif are continuous at some p € A, then f is 
differentiable at p. 


Proof. With p as above, let 
= S > thDef (D) with t = S > trek ef. 
k=1 k=1 


Then ¢ is continuous (a polynomial!) and linear (Corollary 2 in §2). 
Thus by Definition 1, it remains to show that 


| _- 
lim i4/ — $(8)| = 0; 


that is, 
(10) im [r+ A - 10) - Sarisa|=o 
k=1 


To do this, fix ¢ > 0. As A is open and the D;f are continuous at p € A, 
there is a 6 > 0 such that Gj(6) C A and simultaneously (explain this!) 


- 7 E 

(Vee God) |Def(@)— Def) <—, k=1,-..,0 

Hence for any set I C Gz(d) 
- E 
(11) sup |Def(#) — Dif (@)| S - (Why?) 
rE 
Now fix any t € E’, 0 < |t] <6, and let py = 9, 
Be =P+)>_ ties, Kh = Len: 
Then 
Pn = P+) tie =pr+t, 


\Pe — Pr—i| = |te|, and all p, lie in Gg(d), for 


k k n 
iif =} > lta? <4] Solel? = 1 <4, 
=1 i=1 i=l 


|p, — pl = 


as required. 
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As G,(6) is convex (Chapter 4, §9), the segments I, = L[p,—1, Px] all lie in 
Gz(0) C A; and by assumption, f has all partials there. 

Hence by Theorem 1 in $1, f is relatively continuous on all Ix. 

All this also applies to the functions g;, defined by 
(Why?) Here 

Dy gx(Z) = De f(Z) — Def (P). 

(Why?) 

Thus by Corollary 2 in §1, and (11) above, 


lon(De) = Gn (Pea) < De = e—1| ey |Dx f (Z) — Def (P)| 


lA 


E E 
—ltp| < —|t 
= ital <<, 
since 

Pe — Pe—1| = |teee| < |e, 
by construction. 


Combine with (12), recalling that the kth coordinates xz, for py and px_1, 
differ by tp; so we obtain 


\9% (Dk) — Ge (Pr—1)| = |f We) — F(Pe-1) — teDa f(P)| 


(13) eg 
Also, : 

> LF) — F@aa)] = 1B) — 1) 

~ = fP+8) — $B) = AF (see above). 
Thus 


ar Daves =|YoUWi) - FO.a) - wD) 
k=1 k=1 


<n-=ld =eldl. 


As € is arbitrary, (10) follows, and all is proved. 


Theorem 4. /f f: E” — E™ (or f: C" — C™) is differentiable at p, with 
f =(fi,---; fm), then [f’(p)] is an m x n matriz, 


(14) | = (Pehl: 42a 1je. 59, RH 1s ns 
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Proof. By definition, [f’(p)] is the matrix of the linear map ¢ = df(j, -), 
@ = (¢1,---,¢m). Here 


g(t) = Ym DefH 
k=1 


by Corollary 1. 
As f = (fi,---, fm), we can compute D;, f(j) componentwise by Theorem 5 
of Chapter 5, 81, and Note 2 in §1 to get 


Dg f(P) = (Defi lp), ---;Defm(P)) 
- Soe De fil), R= 1.922258, 


I=) 


where the ej are the basic vectors in E™(C™). (Recall that the &, are the 
basic vectors in E” (C).) 


Thus _ 
o(t) = S > ei di(t). 
i=l 
Also, 
Ot) = So te > De fi(P) = Doe D0 teDe fal). 
k=1 i=l i=1 k= 1 


The uniqueness of the decomposition (Theorem 2 in Chapter 3, §§1-3) now 
yields 


C0) => DiGi) G21 sm, FERC"). 
k=1 
If here t = &, then tz = 1, while t; =0 for 7 Ak. Thus we obtain 
bi(€.) = Defi (p), t= los. Mm, B= 1yeaeyn. 


Hence 
(€) = (Vik; U2ks ++ side I 
where 


Vik = b:(€k) = De fi(D)- 


But by Note 3 of §2, viz,...,Umk (written vertically) is the kth column of 
the m x n matrix [¢] = [f’(p)]. Thus formula (14) results indeed. 


In conclusion, let us stress again that while Dzf(p) is a constant, for a fixed 
D; df (p, -) is a mapping 
¢€ L(E’,E), 


especially “tailored” for p. 
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The reader should carefully study at least the “arrowed” problems below. 


Problems on Differentiable Functions 
1. Complete the missing details in the proofs of this section. 
2. Verify Note 1. Describe [f’(p)] for f: E1 — E™, too. Give examples. 


=>3. A map f: E’ — E is said to satisfy a Lipschitz condition (L) of order 
a> 0 at p iff 


(46 > 0) GK € BE’) V¥EG9(5)) |f(@) — f@)| < K\F— pI. 


Prove the following. 
(i) This implies continuity at p (but not conversely; see Problem 7 in 
Chapter 5, §1). 
(ii) LZ of order > 1 implies differentiability at p, with df(j,-) = 0 
on FE’. 
(iii) Differentiability at 7 implies L of order 1 (apply Theorem 1 in §2 
to ¢ = df). 
(iv) If f and g are differentiable at p, then 
1 


li Af||Ag| = 0. 
lim, FealAsIdol 


4. For the functions of Problem 5 in 81, find those p at which f is differ- 
entiable. Find 
Vf(P), af, -), and [f'(p)]. 
[Hint: Use Theorem 3 and Corollary 1.] 
=>5. Prove the following statements. 


(i) If f: E’ — E is constant on an open globe G C E’, it is differen- 
tiable at each p € G, and df(p, -) =0 on E”. 


(ii) If the latter holds for each p € G—Q (Q countable), then f is 
constant on G (even on G) provided f is relatively continuous 
there. 

[Hint: Given p,¢ € G, use Theorem 2 in §1 to get f(p) = f(q).] 


6. Do Problem 5 in case G is any open polygon-connected set in E’. (See 
Chapter 4, §9.) 


=>7. Prove the following. 
(i) If f,g: E’ — E are differentiable at p, so is 


h=af +g, 
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10. 


11. 
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for any scalars a,b (if f and g are scalar valued, a and b may be 
vectors); moreover, 


d(af + bg) = adf +bdg, 
Le., 
dh(p; t) = adf(p;t) + bdg(p;t), Fe E’. 
(ii) In case f,g: E™ — E' or C™ = C, deduce also that 
VA(p) = aV f(p) + bVg(p). 
Prove that if f,g: E’ + E'(C) are differentiable at 7, then so are 


h=gf andk= %. 
f 
(the latter, if f(@) 4 0). Moreover, with a = f(p) and b = g(p), show 
that 

(i) dh =adg+bdf and 

(ii) dk = (adg — bdf)/a?. 
If further E’ = E” (C”), verify that 
(iii) VA(p) = aVg(p) + bVf (p) and 

(iv) Vk(P) = (aVg(P) — dV f(p))/a?. 
Prove (i) and (ii) for vector-valued g, too. 
[Hints: (i) Set ¢ = adg + bdf, with a and b as above. Verify that 

Ah — $(#) = g(P)(Af — af) + FW) (Ag — dg(t)) + (AF)(Ag). 
Use Problem 3(iv) and Definition 1. 
(ii) Let F(t) = 1/f(£). Show that dF = —df/a?. Then apply (i) to gF |] 

Let f: E’ = E™(C™), f =(fi,.--, fm). Prove that 

(i) f is linear iff all its m components fy are; 

(ii) f is differentiable at p iff all f, are, and then df = (dfi,...,dfm). 

Hence if f is complex, df = dfre +7- dfim. 

Prove the following statements. 

(i) If f € L(E’, E) then f is differentiable on E’, and df(p,-) = f, 

pe ELE’. 
(ii) Such is any first-degree monomial, hence any sum of such mono- 


mials. 


Any rational function is differentiable in its domain. 
[Hint: Use Problems 10(ii), 7, and 8. Proceed as in Theorem 3 in Chapter 4, §3.] 
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12. 


13. 


14. 


15. 


*16. 


17. 


Do Problem 8(i) in case g is only continuous at p, and f(p) = 0. Find 
dh. 


Do Problem 8(i) for dot products h = f -g of functions f,g: E’ — 
B™(C™), 
Prove the following. 
(i) If ¢ € L(E”, E*) or ¢€ L(C”,C), then ||¢|| = |a|, with & as in §2, 
Theorem 2(ii). 


(ii) If f: BE" — E! (f: C” = C’°) is differentiable at p, then 
laf, Dil = IV F(P)I- 
Moreover, in case f: EB” > E!, 
IVf(p)| 2 Daf(p) if |u| =1 


and 


VE) 
IVE) 


IV f(p)| = Dzf(P) when v= 


thus 
VFR) = max Dif (P). 


[Hints: Use the equality case in Theorem 4(c’) of Chapter 3, §§1—3. Use formula (7), 
Corollary 2, and Theorem 2(ii).] 
Show that Theorem 3 holds even if 

(i) Dif is discontinuous at p, and 


(ii) f has partials on A — Q only (Q countable, p ¢ Q), provided f is 
continuous on A in each of the last n — 1 variables. 

[Hint: For k = 1, formula (13) still results by definition of Dj; f, if a suitable 6 has 
been chosen. ] 
Show that Theorem 3 and Problem 15 apply also to any f: E’ — E 
where E’ is n-dimensional with basis {U,...,in} (see Problem 12 in 
§2) if we write D;,f for Dz, f. 
[Hints: Assume |t%,| = 1, 1 < k < n (if not, replace %, by u,/|t%|; show that this 
yields another basis). Modify the proof so that the p; are still in Gj(d). Caution: 
The standard norm of £” does not apply here.] 


Let fy: E' — E' be differentiable at pp (k = 1,...,n). For # = 
(%1,.--,2n) € E”, set 


n 


Show that F' and G are differentiable at 7 = (pi,...,pn). Express VF'(p) 
and VG(p) in terms of the f;,(px). 
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[Hint: In order to use Problems 7 and 8, replace the f;, by suitable functions defined 
on E”. For VG(p), “imitate” Problem 6 in Chapter 5, §1.] 


§4. The Chain Rule. The Cauchy Invariant Rule 


To generalize the chain rule (Chapter 5, §1), we consider the composite h = gof 
of two functions, f: E’ — E” and g: E” — E, with E’, E”, and E as before. 


Theorem 1 (chain rule). Jf 
f: E' = E" andg: E" +E 
are differentiable at p and q= f(p), respectively, then 
oo: 
is differentiable at p, and 


(1) dh(p, -) = dg(q, +) o df(p, -). 


Briefly: “The differential of the composite is the composite of differentials.” 


Proof. Let U =df(j,-), V =dg(g,-), and ¢6=VoU. 

As U and V are linear continuous maps, so is ¢. We must show that ¢ = 
dh(B, -): 

Here it is more convenient to write AZ or #— fp for the “t” of Definition 1 
in §3. For brevity, we set (with = f(p)) 


(2) w(@) = Ah— g(AZ) =A@)— hp) -—4(F-P), FEE’, 

(3) u(Z) = Af — U(Az) = f(z) -— f@)-U@-p), tek, 

(4) u(y) = Ag—V(Ay) =9%) -9(Q-VG-G, FEE". 

Then what we have to prove (see Definition 1 in §3) reduces to 
w(t) _ 

(5) He ga” 


while the assumed existence of df(j,-) = U and dg(qg,-) = V can be ex- 
pressed as 


ua) 
(5') lim ea 0, 
and 

(5!” im 2 9, Ge Fe) 
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From (2) and (3), recalling that h = go f and ¢6=V oU, we obtain 
6) F(Z) — 9) — VUE — p)) 
= g(f(£)) — g(a) — V(F(@) — fp) — ul). 
Using (4), with 7 = f(Z), and the linearity of V, we rewrite (6) as 
(F(@)) — 9 — V(F(@) — F(e)) — V(ul@)) 
(f(z)) + V(u(@)). 
(Verify!) Thus the desired formula (5) will be proved if we show that 


) in VOU) _ 
rp Eo 


v(f@) _ 9 


fp |£ — pl - 


(6") 
Now, as V is linear and continuous, formula (5’) yields (6’). Indeed, 
ets v( ue) ) =V(0) =0 
tp |t—pl ep \|e—p 
by Corollary 2 in Chapter 4, §2. (Why?) 
Similarly, (5”) implies (6”) by substituting 7 = f(Z), since 
If(@) — f@)| < Kz — pl 
by Problem 3(iii) in §3. (Explain!) Thus all is proved. 


Note 1 (Cauchy invariant rule). Under the same assumptions, we also have 
(7) dh(p;t) = dg(¢ 8) 


if ¥= df (pit), t¢ E’. 
For with U and V as above, 


Thus if 


we have 
dh(p;t) = o(t) = V(U(E)) = V(8) = dg(G 8), 


proving (7). 
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Note 2. If 
E! =E" (Cc), BY = Eb" (O™) and k= BE” (C”) 


then by Theorem 3 of §2 and Definition 2 in §3, we can write (1) in matrix 
form, 


[A'(P)] = [o OIF): 


resembling Theorem 3 in Chapter 5, §1 (with f and g interchanged). Moreover, 
we have the following theorem. 


Theorem 2. With all as in Theorem 1, let 


E' = BE” cory, EB” = Bm i). 


and 
f=(fi,---sfm)- 
Then 
= 55 Dig(D) De fil); 
i=1 
or, in classical notation, 
O 0 0 


Proof. Fix any basic vector €, in E’ and set 
=O (Pe), S=(Siieees 3m) ek’: 
As f is differentiable at p, so are its components f; (Problem 9 in §3), and 
si = dfi(D; &) = De fil) 
by Theorem 2(ii) in §3. Using also Corollary 1 in §3, we get 


(G3) = ve Dig = er (B)Dig(Q)- 


4=1 4=1 


But as § = df(p; &,), formula (7) yields 
dg(q; 8) = dh(p; x) = Deh(p) 
by Theorem 2(ii) in §3. Thus the result follows. 


Note 3. Theorem 2 is often called the chain rule for functions of several 
variables. It yields Theorem 3 in Chapter 5, 81, ifm =n =1. 
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In classical calculus one often speaks of derivatives and differentials of vari- 
ables y = f(a1,...,%n) rather than those of mappings. Thus Theorem 2 is 
stated as follows. 


Let u=g(yi,---,Ym) be differentiable. If, in turn, each 
Ue Teena) 


is differentiable fori = 1,...,m, then u is also differentiable as a com- 
posite function of the n variables x,, and (“simplifying” formula (8)) we 
have 


(8') Zh ay La 


It is understood that the partials 


a) Oy; 
“ and 24 are taken at some DEE, 
re Ory Lk 
while the 0u/Oy; are at ¢ = f(p), where f = (fi,...,fm). This “variable” 


notation is convenient in aie auiens but may cause ambiguities (see the 
next example). 


Example. 


Let u = g(x,y, z), where z depends on x and y: 
BS Paley): 
Set fi(z,y) =2, folc,.y) =y, f = (hf, fa, fs), and h = go f; so 
h(x, y) = 9(@,y, 2). 


By (8’), 
Ou  OuOdxr Ou Oy | Ou Oz 
dx Ox Ox Oy Ox | Oz Ox 
Here 
Ox Of, _ Oy 
ae Ay =dvand 


for f2 does not depend on x. Thus we obtain 
(9) Ou Ou | Ou Oz 
dx Ox | Oz Ox 
(Question: Is (Ou/dz) (0z/dx) = 0?) 
The trouble with (9) is that the variable u “poses” as both g and h. 
On the left, it is h; on the right, it is g. 
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To avoid this, our method is to differentiate well-defined mappings, not 
“variables.” Thus in (9), we have the maps 


or =ham fie ak, 


with fi, fo, fg as indicated. Then if h = go f, Theorem 2 states (9) 
unambiguously as 


D,h(p) = Dig(G) + D3g(Q) - Dif (P), 
where p € E? and 


7 = f(P) = (P1, Pe, fs(P)). 
(Why?) In classical notation, 
Oh Og | Og Ofs 
dx Ox Oz Ox 
(avoiding the “paradox” of (9)). 


¢ 


Nonetheless, with due caution, one may use the “variable” notation where 
convenient. The reader should practice both (see the Problems). 

Note 4. The Cauchy rule (7), in “variable” notation, turns into 

“ Ou "\ Ou 

10 du = — dy; = — dir, 
(10) U 2 Ay; Y > Die Lk 
where dx, = t, and dy; = df;(p; t). 

Indeed, by Corollary 1 in §3, 


dh(p;t) = S> Dyh(p) + ty and dg(@ 5) = S> Dig(Q) - 8i- 
k=1 i=1 
Now, in (7), 
S = (s1,...,8m) = df (7; 1); 
so by Problem 9 in §3, 
dfi(p;t) =s;, i=1,...,m. 
Rewriting all in the “variable” notation, we obtain (10). 

The “advantage” of (10) is that du has the same form, independently of 
whether u is treated as a function of the x, or of the y; (hence the name 
“invariant” rule). However, one must remember the meaning of dx, and dy;, 
which are quite different. 

The “invariance” also fails completely for differentials of higher order (§5). 

The advantages of the “variable” notation vanish unless one is able to “trans- 
late” it into precise formulas. 
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Further Problems on Differentiable Functions 


1. For E = E” (C’) prove Theorem 2 directly. 
[Hint: Find 
Dghj(P), FG =1,---47, 
from Theorem 4 of 83, and Theorem 3 of §2. Verify that 
Dyh(p) = >> ej Dehg(p) and Dig(G) = D> e; Digs (9), 
j=l j=l 
where the e; are the basic unit vectors in E”. Proceed.] 
2. Let o(a,y,2) =u, 2 = filr,@), y= fol’, 2), @ = falr,@), and 
i, _ (Fis fy 73)? EP — cae 
Assuming differentiability, verify (using “variables” ) that 
Ou Ou Ou Ou Ou 


= —dxr+—dy+—dz= dr + — 
du ae! a yt a z ar r+ pp a0 


by computing derivatives from (8’). Then do all in the mapping notation 
for H = go f, dH(p;t). 
3. For the specific functions f, g, h, and k of Problems 4 and 5 of §2, set 
up and solve problems analogous to Problem 2, using 
(a)kof;  (b)gok;  (c)foh; — (d) hog. 
4. For the functions of Problem 5 in §1, find the formulas for df(j;t). At 
which p does df (j, -) exist in each given case? Describe it for a chosen jp. 


5. From Theorem 2, with E = E'(C), find 


VP) = D> Deg DV fe P). 
k=1 


6. Use Theorem 1 for a new solution of Problem 7 in §3 with E = E'(C). 
(Hint: Define F on E’ and G on E? (C?) by 
F(Z) = (f(@),9(@)) and G(y) = ay + bye. 


Then h = af + bg = Go F. (Why?) Use Problems 9 and 10(ii) of §3. Do all in 
“variable” notation, too.] 


7. Use Theorem 1 for a new proof of the “only if” in Problem 9 in 83. 
[Hint: Set f; = go f, where g(Z) = 2; (the ith “projection map”) is a monomial. 
Verify]] 


8. Do Problem 8(i) in §3 for the case E’ = E? (C?), with 


f(#) = and g(Z) = 22. 
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(Simplify!) Then do the general case as in Problem 6 above, with 
GY) = y1y2. 


. Use Theorem 2 for a new proof of Theorem 4 in Chapter 5, §1. (Proceed 


as in Problems 6 and 8, with E’ = E', so that Djh =h’.) Do it in the 
“variable” notation, too. 


Under proper differentiability assumptions, use formula (8’) to express 
the partials of u if 


(i) w= g(z,y), «= f(r)h), y = auras + Of (r); 
(ii) w= g(r,0), r= f(a + f(y), 8 = Fl@fly)): 

(in) 42 = g(a ya). 

Then redo all in the “mapping” terminology, too. 


Let the map g: E! — E' be differentiable on E'. Find |VA(p)| if 
h=gof and 


(ii) f= Gre 1(Z) = Sa fo(Z) = |Z|?, Ze E”. 


(Euler’s theorem.) A map f: E” — E' (or C” = C) is called homoge- 
neous of degree m on G iff 
(VtcE'(C)) f(t#)=t"f@) 
when Z, tz € G. Prove the following statements. 
(i) If so, and f is differentiable at 7 € G (an open globe), then 


PV f(P) = mf (P). 
*(ii) Conversely, if the latter holds for all @ € G and if 0 ¢ G, then f is 
homogeneous of degree m on G. 
(iii) What if 0 € G? 


[Hints: (i) Let g(t) = f(tp). Find g’(1). (iii) Take f(a, y) = vy? ifa <0, f =0 if 
x > 0, G=Go(1).] 


Try Problem 12 for f: E’ — E, replacing p- V f(p) by df (p; 7p). 
With all as in Theorem 1, prove the following. 
(i) If E’ = E' and = f'(p) £0, then h’(p) = Dgg(q). 


(ii) If @ and @ are nonzero in E’ and at + bv 4 0 for some scalars a, b, 
then 


Daa+oef (p) = aDef (Pp) + Def (P). 
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(iii) If f is differentiable on a globe Gy, and @ 4 0 in E’, then 
Di f(p) = lim Dz(p). 


[Hints: Use Theorem 2(ii) from §3 and Note 1.] 
15. Use Theorem 2 to find the partially derived functions of f, if 
(i) f(x,y, z) = (sin(xy/z))"; 
(ii) f(x,y) = log, |tan(y/z)]. 
(Set f = 0 wherever undefined.) 


85. Repeated Differentiation. Taylor’s Theorem 


In 81 we defined t-directed derived functions, Dzf for any f: E’ — E and any 
aA#O in E'. 

Thus given a sequence {i} C E’ — {0}, we can first form Dz, f, then 
Di,(Di,f) (the t-directed derived function of Dz, f), then the w3-directed 
derived function of Dz,(Dz, f), and so on. We call all functions so formed the 
higher-order directional derived functions of f. 

If at each step the limit postulated in Definition 1 of §1 exists for all pin a 
set B C E", we call them the higher-order directional derivatives of f (on B). 

If all @; are basic unit vectors in E” (C”), we say “partial” instead of “di- 
rectional.” 

We also define Dif = Dzf and 


k k-1 
(1) Din ity... f — Di, (Dia ity. ite_at > k = 2, 3, LR) 


and call DE ay...a,/ 2 directional derived function of order k. (Some authors 


denote it by DE ge 4. et 


U 


If all w; equal uw, we write De f instead. 


For partially derived functions, we simplify this notation, writing 12... for 
é,é)... and omitting the “k” in D* (except in classical notation): 
O° f O° f 


Dyf = D3 2, f - Diuif = Dif - etc. 


Ox Ox» ‘ Ox?’ 
We also set D°f = f for any vector w. 


Example. 
(A) Define f: E? — E' by 


; 2. 5/2 
f(0,0) =0, fay) =“ P 
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Then 


of 


ot + Ag2y2 — y4 
of = Di flay) = WY 
r. 


(x2 + y2)2 
whence D, f(0,y) = —y if y 4 0; and also 
f(a, 0) = f (0,0) 


x 


P] 


Df (0,0) = lim =0. (Verify!) 


Thus D, f(0,y) = —y always, and so Di2f(0,y) = —1; Dio f (0,0) = -1. 
Similarly, 
x(a? — 4x2y? — y4) 
(x2 + y2)2 
if x #0 and D2f(0,0) =0. Thus (Vx) Dof(x,0) = 2 and so 


Dof (x,y) = 


Doi f (x, 0) =1 and Do; f (0,0) =1 # D2 f (0,0) =-l. 


The previous example shows that we may well have Dio f #4 Doi f, or more 
generally, ieee fF De. f. However, we obtain the following theorem. 


Theorem 1. Given nonzero vectors t and U in E’, suppose f: E' > E has 
the derivatives 


Daf, Daf, and D25 


on an open set A C E’. 


If D2.,f is continuous at some p € A, then the derivative D2, f(p) also exists 
and equals D2. f (p). 


Proof. By Corollary 1 in §1, all reduces to the case |i/| = 1 = |v|. (Why?) 
Given € > 0, fix 6 > 0 so small that G = G5(d) C A and simultaneously 


(2) sup |Disf(#) — Dis f(P)| < € 
#eG 


(by the continuity of D2.,f at 7). 
Now (Vs,t € E') define H;: E' — E by 


H,(s) = Def(p+ tu + sv). 


f= ey 
2 2 
If s,t € I, the point ¢ = p+ tu + sv is in Gz(d) C A, since 
6 


0) 
r= 4 — |tu ul) <= —_-— 6. 
z— Al = lt + sd <5 +5 


Let 


85. Repeated Differentiation. Taylor’s Theorem 37 


Thus by assumption, the derivative D2,.f(p) exists. Also, 


Hi(s) = Jim, x [H,(s + As) — H;(s)] 
= jim, = [Def(@ + As-#) — Daf ®) 


But the last limit is D2,f(Z), by definition. Thus, setting 
he(s) = Hi(s) — sDief (B), 
we get 
hi(s) = Hy(s) — Dis f (P) 
= Dig f(@) — Dif). 
We see that h; is differentiable on I, and by (2), 
sup |h;(s)| < sup |Disf(@) — Dis f(P)| < € 
sel ZEG 
for all t € J. Hence by Corollary 1 of Chapter 5, 84, 
|he(s) — he(0) < Is| sup [hs () < |sle. 
o€ 


But by definition, 
hi(s) = Daf (p+ té + sd) — sD2 5 f (9) 


and 
h,(0) = Def (p+ tu). 
Thus 
(3) |Dzf (B+ td + sv) — Def (P+ th) — sDzgf(B)| < Isle 
for all s,t € I. 
Next, set 
G,(t) = f(@+té+ sv) — f(pt ti) 
and 


gs(t) = Gs(t) — st Dis f(D). 
As before, one finds that (Vs € I) g, is differentiable on J and that 
gs(t) = Daf (B+ ti + sv) — Daf (B+ ti) — sDizf@) 
for s,t € I. (Verify!) 
Hence by (3), 
sup |95(t)| < |sle. 
tel 
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Again, by Corollary 1 of Chapter 5, 84, 

|gs(t) — gs(0)| < |stle, 
or by the definition of g, (assuming s,t € J — {0} and dividing by st), 


1 
st 


1 
st 


[f(p+ té+ sv) — f(p+ ta)| — Dz sf (Pp) 


[f(p+ sv) — f@)]| <e. 
(Verify!) Making s — 0 (with t fixed), we get, by the definition of Dzf, 

1 hk a 

7Def (P+ ta) = 7DefP) — Dig f(B)| <e 


whenever 0 < |t| < 6/2. 
As ¢€ is arbitrary, we have 


D3; f(p) = lim +[Dof (0+ ti) — Daf (P)) 


But by definition, this limit is the derivative D2, f(p). Thus all is proved. 


Note 1. By induction, the theorem extends to derivatives of order > 2. 
Thus the derivative Dé, ap...¢,/ 18 independent of the order in which the w; 
follow each other if it exists and is continuous on an open set A C E’, along 
with appropriate derivatives of order < k. 

If E’ = E” (C”), this applies to partials as a special case. 


For E” and C” only, we also formulate the following definition. 
Definition 1. 
Let E’ = E” (C"). We say that f: E’ — E is m times differentiable at 
p © E’ iff f and all its partials of order < m are differentiable at p. 

If this holds for all p in a set B C E’, we say that f is m times 
differentiable on B. 

If, in addition, all partials of order m are continuous at jf (on B), we 
say that f is of class CD™, or continuously differentiable m times there, 
and write f € CD™ at p (on B). 

Finally, if this holds for all natural m, we write f € CD™ at p (on B, 
respectively). 


Definition 2. 


Given the space E’ = E”"(C”), the function f: E’ — E, and a point 
p © E", we define the mappings 


GAs i aes ne 5 ee 
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from E’ to E by setting for every t = (t1,...,tn) 


d' f (pt) = > Dif) ti 


i=1 
(4) PFGE) => >) Dy f@O - tit, 
j=l i=l 
d® f (p t) = > S° Dijrf (Pp) - titjtk, and so on. 
k=1j=1 i=1 


We call d” f(p,-) the mth differential (or differential of order m) of f at p. 
By our conventions, it is always defined on E” (C”) as are the partially derived 
functions involved. 

If f is differentiable at p (but not otherwise), then d' f(p;t) = df(p;t) by 
Corollary 1 in §3; d' f (p,-) is linear and continuous (why?) but need not satisfy 
Definition 1 in 83. 

In classical notation, we write dx; for t;; e.g., 


>>> ae dx; dx; 
7 On; On, ' Z 


j=l i=l 


Note 2. Classical analysis tends to define differentials as above in terms of 

partials. Formula (4) for df is often written symbolically: 
0 7) 3) m 

5 d™ =| da dty+---4 din) , MeSH 1 Dee 
(5) t Oxy Des = " Aan i 
Indeed, raising the bracketed expression to the mth “power” as in algebra 
(removing brackets, without collecting “similar” terms) and then “multiplying” 
by f, we obtain sums that agree with (4). (Of course, this is not genuine 
multiplication but only a convenient memorizing device.) 


Example. 
(B) Define f: E? — E' by 
fle;y) = esin y. 
Take any p = (x,y) € E?. Then 


Di f(x,y) =siny and Dof (x,y) = xcosy; 
Diof (x,y) = Dai f(x,y) = cosy, 
Diy fey) = 0, and Doo f(x,y) =—xsiny; 
Diu f(x,y) = Duef(z,y) = Diaf (x,y) = Dauf(x,y) = 0, 
Doo f(x,y) = Daf (x,y) = Dioo f(x,y) = —siny, and 
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Do22 f(x,y) = —x cosy; etc. 


As is easily seen, f has continuous partials of all orders; so f € CD™ on 
all of E?. Also, 


df (pt) = ti Di f (p) + teDof (p) 
=t,siny + tex cos y. 


In classical notation, 


df=d'f = Fadet Sed y 
= sinydzx + «cosy dy; 
oe 2 O° f ay 
2 
a Mele) = da” Si es aac a2 


= eee — asin y dy’; 
d? f = —3siny dx dy? — x cosy dy’; 
and so on. (Verify!) 


We can now extend Taylor’s theorem (Theorem 1 in Chapter 5, §6) to the 
case E’ = E"(C™). 
Theorem 2 (Taylor). Let i= #— p40 in E! = E” (C"). 

[ff: E' = E ism+1 times differentiable on the line segment 


I= L{p,z] Cc BE’ 
then 
3 ide aise 
A -fO = Ls F FCG + Rm, 
i=1 ~ 
with 
K 
6 Ty — — 5) Km L E 5) 
(6) Rl < oy 
and 
(6') 0< Km < sup|d™*" f(5; a). 
sel 


Proof. Define g: E! > E’ andh: E! > E by g(t) =pt+ttiandh=f og. 
As E" = E” (C™), we may consider the components of g, 


ge(t) = pert+tup, k<n. 


Clearly, gx, is differentiable, g/,(t) = ux. 
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By assumption, so is f on J = L|p,Z]. Thus, by the chain rule, h = f og is 
differentiable on the interval J = [0,1] c E'; for, by definition, 
pt+tu € L{p,z] iff t € [0,1]. 
By Theorem 2 in 84, 


(7) h'(t) = > Def (P+ ti) - un = df (P+ tia), te J. 
k=1 
(Explain!) 
By assumption (and Definition 1), the D;,f are differentiable on J. Hence, 
by (7), h’ is differentiable on J. Reapplying Theorem 2 in §4, we obtain 


h(t) = S 2S 0 Daj f (P+ ta) - ugu; 
=1 k= 
= f(p+taa), te J. 


BR 


By induction, h is m+ 1 times differentiable on J, and 
(8) AM (t) =d' f(p+ti;a), te J, i=1,2,...,.m4+1. 
The differentiability of h (i < m) implies its continuity on J = [0,1]. 


Thus h satisfies Theorem 1 of Chapter 5, 86 (with x = 1, p= 0, and Q = 9); 
hence 


(9) R 2 fin. K, ¢ E! 


Km < sup |A™ (¢)] 
ted 


By construction, 
A(t) = f(g(t)) = fw + tu); 
Xo) 


h(1) = fw +t) = f(#) and h(0) = f(p). 
Thus using (8) also, we see that (9) implies (6), indeed. 


Note 3. Formula (3’) of Chapter 5, §6, combined with (8), also yields 


1 1 
Rm = =| Are say" di 
1 1 


| 
a 
3 
+ 
BR 
= 
Za 
++ 
nH 
S 
cS! 
any 
| 
nas) 
3 
a 
a 
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Corollary 1 (the Lagrange form of R,,). If E = E' in Theorem 2, then 

= m+] £72. > 
(10) Rm = ay a FBG) 


for some § € L(p, £). 


Proof. Here the function fh defined in the proof of Theorem 2 is real; so The- 
orem 1’ and formula (3’) of Chapter 5, §6 apply. This yields (10). Explain! 


Corollary 2. If f: E"(C") > E is m times differentiable at p and if i 4 0 
(p,u € E” (C™)), then the derivative Df (p) exists and equals d™ f(p; ti). 


This follows as in the proof of Theorem 2 (with t = 0). For by definition, 
ee re 
Di f(p) = lim — [f+ st) — fF) 
1 
= lim 7 [h(s) — h(0)] 
= h'(0) = df(p; ui) 
by (7). Induction yields 
Di £(P) = h™ (0) = a"; a) 
by (8). (See Problem 3.) 
Example. 
(C) Continuing Example (B), fix 
p= (1,0); 


thus replace (a, y) by (1,0) there. Instead, write (x, y) for Z in Theorem 2. 
Then 
d=z£-p=(«—1,y); 
so 
uy =x—-—1l=dz and u2=y = dy, 
and we obtain 
df (p; ui) = Di f(1,0)-(@— 1) + Daf(1,0) -y 
= (sin0)-(w—1)+(1-cos0)-y 
=Y; 
@ (Biz) = Dir f(1,0) + (@ — 1)? + 2Dief (1,0) - (w — Ly 
+ Doo f (1,0) -y* 
= (0) - (a — 1)? + 2(cos0) - (a — 1)y — (1-sin0)- y” 
= 2(r —1)y; 
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and for all = (s1, s2) € J, 
d? f (8: @) = Di f(s1, 82) - (a — 1)? +3 Dio f(s1, 82) - (a — 1)?y 
(10’) + 3 Dio2f (81, 82) - (w@ — 1)y? + Dove f (81, $2) -y? 
= —3sin 9° (x — 1)y? — $1 cos 82+ y°. 


Hence by (6) and Corollary 1 (with m = 2), noting that f(p) = f(1,0) = 
0, we get 


f(x,y) =@-siny 


oe =y+(e—l)yt+ Ro, 


where for some 8’ € I, 


1 1 
Ro = — a’ f (8a) = = [-3sin sq - (x — 1)y” — 8; cos sy -y"]. 


As 3 € L(p,#), where p = (1,0) and # = (2, y), $1 is between 1 and 2; so 
|s1] < max(|z],1) < Ja] +1. 


Finally, since | sin s2| < 1 and | cos s2| < 1, we obtain 


1 
[Rol <5 [Be — 11 + (lel +1) lal] 
This bounds the maximum error that arises if we use (11) to express x sin y 
as a second-degree polynomial in (2 — 1) and y. (See also Problem 4 and 


Note 4 below.) 


Note 4. Formula (6), briefly 


Af = S> as + Ro, 
i=l 


a) 


generalizes formula (2) in Chapter 5, §6. 
As in Chapter 5, 86, we set 


Pm(@) = f+ 2 GA FGE-) 
i=1 ~ 


and call P,, the mth Taylor polynomial for f about p, treating it as a function 
of n variables x, with % = (%1,...,%n). 
When expanded as in Example (C), formula (6) expresses f(Z) in powers of 


Uk = Lk — Pk, | ad renee 


plus the remainder term Ry. 


4A 
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If f € CD™ on some Gj and if R», — 0 as m — oo, we can express f() as 
a convergent power series 


m— oo 


f(@) = lim, Pa(@) =f) +2 5M -D. 
i=l ~ 


We then say that f admits a Taylor series about p, on Gg. 


Problems on Repeated Differentiation and Taylor Expansions 


1. 


Complete all details in the proof of Theorem 1. What is the motivation 
for introducing the auxiliary functions h; and g, in this particular way? 


. Is symbolic “multiplication” in Note 2 always commutative? (See Ex- 


ample (A).) Why was it possible to collect “similar” terms 


oy ay 
andy Dy dx dy and Don 


in Example (B)? Using (5), find the general formula for d? f. Expand it! 


dy dx 


. Carry out the induction in Theorem 2 and Corollary 2. (Use a suitable 


notation for subscripts: ki kg... instead of jk....) 


. Do Example (C) with m = 3 (instead of m = 2) and with p = (0,0). 


Show that R,, — 0, i.e., f admits a Taylor series about 7. 
Do it in the following two ways. 
(i) Use Theorem 2. 


(ii) Expand siny as in Problem 6(a) in Chapter 5, §6, and then mul- 
tiply termwise by 2. 


Give an estimate for R3. 


. Use Theorem 2 to expand the following functions in powers of x — 3 and 


y +2 exactly (choosing m so that R,, = 0). 
(i) f(x,y) = 2ay? — 3y? + ya? — 2°; 
(ii) f(w,y) = 2* — ay? + 2ay — 1; 


(iii) f(z,y) = 2°y — ary? — 2°. 


. For the functions of Problem 15 in §4, give their Taylor expansions up 


to Ra, with 


in case (i) and 


in (ii). Bound Ro. 
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hs 


=10. 


11. 


(Generalized Taylor theorem.) Let @ = £—p #4 0 in E’ (E’ need not be 
E” or C”); let I = L[p,Z]. Prove the following statement: 

If f: E’ > E and the derived functions Dif (i < m) are relatively 
continuous on I and have w-directed derivatives on I—Q (Q countable), 
then formula (6) and Note 3 hold, with d' f(p; a) replaced by Di f(p). 


[Hint: Proceed as in Theorem 2 without using the chain rule or any partials or 
components. Instead of (8), prove that h(t) = Dt f (p+ti) on J-Q’, Q’ = 97 1[Q].] 


(i) Modify Problem 7 by setting 


Thus expand f(Z) in powers of |Z — jj. 
(ii) Deduce Theorem 2 from Problem 7, using Corollary 2. 


. Given f: E?(C?) = E, f € CD™ on an open set A, and &€ A, prove 


that (Vi € E? (C?)) 
df(Ra=S° (‘) whup? Diy f(8), 1Si<m, 
J 


where the (;) are binomial coefficients, and in the jth term, 


ky = ky =+++ = hy =2 


and 
kin =:--=k,=1. 
Then restate formula (6) for n = 2. 
[Hint: Use induction, as in the binomial theorem.] 
Given p € E’ = E” (C”) and f: E’ > E, prove that f ¢ CD! at p iff f 
is differentiable at p and 


(Ve >0) (Ad >0) (V¥EG5(d)) Id fH -)- a F(Z, -)Il <e, 


with norm || || as in Definition 2 in §2. (Does it apply?) 
(Hint: If f € CD!, use Theorem 2 in §3. For the converse, verify that 


nm 


So [Def (P) — Def (@Ite 


k=1 


e> |d' ft) — a’ (#6) = 


if Z € Gg(d) and |é] < 1. Take f= &, to prove continuity of Dy f at 7] 
Prove the following. 
(i) If ¢: E” — E™ is linear and [] = (viz), then 


Ol? < S- loin l?. 
i,k 
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(ii) If f: BE” — E™ is differentiable at p, then 
= 2 2 
laf (2, IP < So De fi (@)/?. 
i,k 
(iii) Hence find a new converse proof in Problem 10 for f: BE” — E™. 


Consider f: C” — C™, too. 
(Hints: (i) By the Cauchy—Schwarz inequality, |¢(Z)|? < Zl? ee \vin|?. (Why?) 
(ii) Use part (i) and Theorem 4 in §3.] 


12. (i) Find d?u for the functions of Problem 10 in §4, in the “variable” 
and “mapping” notations. 


(ii) Do it also for 
u= f(2,y,z)=(@? +? +27)3 
and show that Di, f + Doof + D33f = 0. 
(iii) Does the latter hold for u = arctan 27 
x 
13. Let u = g(x,y), x =rcos, y =rsin@ (passage to polars). 


Using “variables” and then the “mappings” notation, prove that if g 
is differentiable, then 


OW Ou. , Ou 

(i) ar = €08 6 ree 5, and 
Ou? 1 Ou? 

oo De 2 pees peigeetbas 

(ii) [Vola yl" = (ae) = & 50) 


2 2 2 
es at ater ti, 


dr 00? or2?  ? 962 


14. Let f,g: E' — E' be of class CD? on E!. Verify (in “variable” notation, 
too) the following statements. 


(i) Dyh= a? Dagh if ae b (fixed) and 


(iii) Assuming g € CD?, express 


h(x,y) = flax +y) + gly — az). 
(ii) 2? Dyyh(a, y) + 2ry Digh(x,y) + y?Dogh(x, y) = 0 if 


nen =a4(8) +02) 


r 
(iii) Dyh : Dah = Doh . Dizh if 
h(x,y) = 9(f(x) +y). 
Find Dygh, too. 
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15. Assume E’ = E"(C™) and BY” = E™(C™). Let f: BE’ — EB” and 
g: E” — E be twice differentiable at p € E’ and g = f(p) € EB”, 
respectively, and set h = go f. 

Show that h is twice differentiable at p, and 


a?’ h(p; t) = d?g(q; 8) + dg(%¥), 
where t € E’, ¥= df(p;t), and & = (v1,...,Um) € E” satisfies 
vu, = a f,(pt), i=1,...,m. 
Thus the second differential is not invariant in the sense of Note 4 in §4. 
[Hint: Show that 
Dyih(p) = Sy. > Dat DQ) Dr fil P)Dif; (P) + Spel Q)Drifi(P)- 
j=1i=l i=l 
Proceed.| 
16. Continuing Problem 15, prove the invariant rule: 
d" h(p; t) = d" 9(¢: 8), 


if f is a first-degree polynomial and g is r times differentiable at ¢. 
[Hint: Here all higher-order partials of f vanish. Use induction.| 


§6. Determinants. Jacobians. Bijective Linear Operators 


We assume the reader to be familiar with elements of linear algebra. Thus we 
only briefly recall some definitions and well-known rules. 


Definition 1. 


Given a linear operator ¢: E” — E” (or ¢: C™ > C”), with matrix 


[Ol] = (ee ly. ty Tyee gt 


we define the determinant of |¢] by 


U11 D419 eyes Vin 
U21 VU22 «++ Van 
det[¢] = det(vix) = 
(1) 
Uni Un2 cee Unn 


= 0 (-1) v1g, vats «+ Unken 
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where the sum is over all ordered n-tuples (k1,..., kn) of distinct integers 
kj (1<k; <n), and 


Recall (Problem 12 in §2) that a set B = {t),%2,...,0,} in a vector space 
E is a basis iff 


(i) B spans E, i.e., each 0 € E has the form 


nm 
v= ) A,U; 
i=1 


for some scalars a;, and 
(ii) this representation is unique. 


The latter is true iff the v; are independent, i.e., 


n 
) a;v; = 0 < a, =0, 7=1,...,n. 
i=1 


If E has a basis of n vectors, we call E n-dimensional (e.g., E” and C”). 
Determinants and bases satisfy the following rules. 
(a) Multiplication rule. If ¢,g: BE” — E” (or C” > OC”) are linear, then 
det[g] - det|4] = det([9] [¢]) = detlg o 4] 

(see §2, Theorem 3 and Note 4). 

(b) If d(#) = # (identity map), then [d] = (vix), where 
0 iftAk and 
“a= { 1 ifi=k- 
hence det|¢] = 1. (Why?) See also the Problems. 


(c) An n-dimensional space E is spanned by a set of n vectors iff they are 
independent. If so, each basis consists of exactly n vectors. 


Definition 2. 
For any function f: E” — E” (or f: C" — C™), we define the f-induced 
Jacobian map Jp: E" — E! (Jp: C” = C) by setting 
J7(Z) = det( vig), 
where vj, = D, f;(Z), Z € E” (C™), and f = (fi, ---,fn)- 


The determinant 


Js (p) = det (De fil) 
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is called the Jacobian of f at p. 
By our conventions, it is always defined, as are the functions Dy fi. 


Explicitly, J+(p) is the determinant of the right-side matrix in formula (14) 
in §3. Briefly, 
J, = det( Dz f;). 


By Definition 2 and Note 2 in 85, 
J;(p) = det(d" f(p, -)]. 
If f is differentiable at p, 
J; (p) = det|f"(p)]- 
Note 1. More generally, given any functions v;,: E’ — E+(C), we can 
define a map f: E’ — E'(C) by 
f(@) = det(vie(#)); 


briefly f = det(vi,), i,k =1,...,n 

We then call f a functional determinant. 

If E’ = E” (C”) then f is a function of n variables, since # = (41, %2,...,%n). 
If all vj, are continuous or differentiable at some p € EL’, so is f; for by (1), f 
is a finite sum of functions of the form 


(1)? vikey Viks -»- Viken 
and each of these is continuous or differentiable if the v;zx, are (see Problems 7 
and 8 in §3). 
Note 2. Hence the Jacobian map Jy is continuous or differentiable at p if 
all the partially derived functions Df; (i,k <n) are. 


If, in addition, Jy(p) # 0, then Jp 4 0 on some globe about p. (Apply 
Problem 7 in Chapter 4, §2, to |J,|.) 


In classical notation, one writes 


Ofiy---1fn) 6 rece 
Ol Sie vnc a ” A(a1,.. ne) 


for J e( Gf): Here: (jij <1.3n) = f Cty oq) 

The remarks made in §4 apply to this 
rule easily yields the following corollary. 
Corollary 1. If f: E” — E” and g: E” — E” (or f,g: C™ — C™) are 
differentiable at pf and ¢ = f(p), respectively, and if 


h=gof, 


66 


variable” notation too. The chain 
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then 
(i) In(P) = Jg(@) - Jp (p) = det(zix), 
where 
Zin = Dehua (p), 19 hoon 

or, setting 

(Uigs2<5 ty) = 6 is <224n) and 

(Uixstos Ua) = f @iysxig tn) Coariables”), 
we have 


. Oui, ...,Un) OCU, -«-,t%m) O15... 9m) _ | 
= Aetiyssatin)  OWiyneryQe) Olnyuanqtn) 


Proof. By Note 2 in 84, 
[h’(p)] = [o'@O) - LF). 
Thus by rule (a) above, 


det[h'(p)] = det[g’(q)] - det[f’(P)], 
In(P) = Jg(Q) » Fp). 


Also, if [h’(p)| = (zx), Definition 2 yields z;, = D,hi(p). 
This proves (i), hence (ii) also. 


In practice, Jacobians mostly occur when a change of variables is made. 
For instance, in E?, we may pass from Cartesian coordinates (x,y) to another 
system (u,v) such that 


2= filu;v) and y = folu,v). 
We then set f = (f1, fo) and obtain f: E? — E?, 
J; = det(Dif,), ht = 1,2. 


Example (passage to polar coordinates). 
Let x = fi(r,0) =rcosé@ and y = fo(r,@) =rsind. 
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13 


Then using the “variable” notation, we obtain J(r,@) as 


Ox Ox 
(x,y) _| dr 00 
O(r, A) Oy Oy 
Or 00 


cos@ —rsind | 


sin@0 rcosé 


rcos?6+rsin?6 =r. 
Thus here Jp(r,0) =r for all 7,6 € E'; Jy is independent of 0. 


We now concentrate on one-to-one (invertible) functions. 


Theorem 1. For a linear map ¢: E” — E” (or ¢: C” — C”), the following 
are equivalent: 


(i) & is one-to-one; 

(ii) the column vectors 01,...,Un of the matrix [| are independent; 
(iii) @ is onto E” (C”); 
(iv) det|¢] # 


Proof. Assume (i) and let 


Me 
ie) 

= 

Sl 
Ol 


To deduce (ii), we must show that all c, vanish. 
Now, by Note 3 in §2, % = (&); so by linearity, 


implies 


k=1 
Hence by Theorem 2 in Chapter 3, §§1-3, c, = 0, k =1,...,n, and (ii) follows. 
Next, assume (ii); so, by rule (c) above, {v),...,¢,} is a basis. 


Thus each 7 € E" (C”) has the form 
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where 


= S° apex (uniquely). 


1 
Hence (ii) implies both (iii) and (i). (Why?) 
Now assume (iii). Then each ¥ € E” (C”) has the form 7 = ¢(Z), where 


by Theorem 2 in Chapter 3, 881-3. Hence again 


n 


T= do eeb(&%) = >> weve; 
k=1 


k=1 
so the % span all of E”(C”). By rule (c) above, this implies (ii), hence (i), 
too. Thus (i), (ii), and (iii) are equivalent. 
Also, by rules (a) and (b), we have 
det[g] - det[g~*] = det[gog""] = 1 


if @ is one-to-one (for 6o¢~* is the identity map). Hence det[d] 4 0 if (i) holds. 
For the converse, suppose ¢ is not one-to-one. Then by (ii), the %% are not 
independent. Thus one of them is a linear combination of the others, say, 


n 
v1 = ; AKU: 


2 
But by linear algebra (Problem 13(iii)), det[¢] does not change if 0, is re- 
placed by 


> 


Thus det[¢] = 0 (one column turning to 0). This completes the proof. 


Note 3. Maps that are both onto and one-to-one are called bijective. Such 
is ¢ in Theorem 1. This means that the equation 


o(@) =¥ 


has a unique solution 


for each y. Componentwise, by Theorem 1, the equations 


n 
) LeVik =Yi, t= l,...,n, 
k=1 
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have a unique solution for the x, iff det(vix) 4 0. 
Corollary 2. If 6 € L(E’,E) is bijective, with E’ and E complete, then 
o-'€ L(E,E’). 
Proof for E = E"(C”).! The notation ¢ € L(E’, E) means that ¢: E’ — E 
is linear and continuous. 

As ¢ is bijective, ¢-!: E — E’ is linear (Problem 12). 

If E = E” (C”), it is continuous, too (Theorem 2 in §2). 

Thus ¢~! € L(E, E’). 


Note. The case FE = E"(C”) suffices for an undergraduate course. (The 
beginner is advised to omit the “starred” §8.) Corollary 2 and Theorem 2 
below, however, are valid in the general case. So is Theorem 1 in §7. 


Theorem 2. Let E, E’ and ¢ be as in Corollary 2. Set 
= 1 
lo" ==. 
E 
Then any map @ € L(E',E) with ||@ — ¢|| < € is one-to-one, and 0~' is 


uniformly continuous. 


Proof. By Corollary 2, ¢~! € L(E, E’), so ||¢~"|| is defined and > 0 (for ¢~1 
is not the zero map, being one-to-one). 
Thus we may set 


1 = 1 
eS oq)’ Ilo ‘| an, 
Clearly ¢ = ¢71(y/) if ¥ = (2). Also, 
Ios =I 


by Note 5 in §2. Hence 


(2) |e(#)| = ela 


forall Ze E’ and Ye E. 
Now suppose ¢ € L(E’, F) and ||@ — || =o <e. 
Obviously, 6 = ¢ — (¢ — 8), and by Note 5 in §2, 


(eo — 8) (@)| < Ilo — All |@] = ola]. 


| See *§8 for the general case. 
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Thus for every # € E’, 


(3) = |6(#)| — o|z| 


by (2). Therefore, given p 47 in E’ and setting # = p— 7 4 0, we obtain 
(4) |9(p) — O(F)| = |0@— F)| = |A(#)| 2 (€ — o) [a] > 0 
(since o < €). 

We see that p 4 7 implies 0() 4 0(7); so 6 is one-to-one, indeed. 

Also, setting 0(#) = 7 and # = @~1(Z) in (3), we get 

JJ 2 (€- o)lO*(); 

that is, 
(5) Ja" (ZI < (e- 0) "121 


for all Z in the range of 0 (domain of 6~*). 


Thus @~+ is linearly bounded (by Theorem 1 in §2), hence uniformly con- 
tinuous, as claimed. 


Corollary 3. If E' = E = E” (C”) in Theorem 2 above, then for given ¢ and 
6 > 0, there always is 6’ > 0 such that 


\|9 — d|| < 6’ implies ||@-' — 67 1]| < 6. 
In other words, the transformation ¢ > $~! is continuous on L(E), E = 
BE (C™), 
Proof. First, since E’ = E = E”(C™), @ is bijective by Theorem 1 (iii), so 
0-1 € L(E). 
As before, set ||9 — ¢|| =a <e. 
By Note 5 in §2, formula (5) above implies that 


Jo < 
o 
Also, 
o-10(0-¢)08-t=g-1- 971 
(see Problem 11). 
Hence by Corollary 4 in §2, recalling that ||¢~1|| = 1/e, we get 
a 


|o-* — "|| < lo" - 18 — ol] - 1-7] < 5 > 0 aso > 0. 
E(é—0) 
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Problems on Bijective Linear Maps and Jacobians 


(i) Can a functional determinant f = det(v;;,) (see Note 1) be contin- 
uous or differentiable even if the functions v;, are not? 


(ii) Must a Jacobian map Jy be continuous or differentiable if f is? 
Give proofs or counterexamples. 


Prove rule (b) on determinants. More generally, show that if f(Z) = # 
on an open set A C £” (C™), then Jy = 1 on A. 


« Let f: BE = E” (or C® > C™), Ff = Giyseei Jn): 


Suppose each f, depends on xz only, i.e., 
Sf (Z) = fr(y) if te = yr, 


regardless of the other coordinates x;,y;. Prove that Jp = [];_, De fr- 
[Hint: Show that D, f; = 0 if i 4k] 


. In Corollary 1, show that 


In(B) = TI De fel) - Jo 
k=1 


6 


if f also has the property specified in Problem 3. Then do all in “vari- 


ables,” with yz, = yx(xp) instead of fr. 


. Let E’ = E' in Note 1. Prove that if all the v;, are differentiable at p, 


then f’(p) is the sum of n determinants, each arising from det(v;,), by 
replacing the terms of one column by their derivatives. 
[Hint: Use Problem 6 in Chapter 5, §1.] 


. Do Problem 5 for partials of f, with E’ = E” (C”), and for directionals 


Dzf, in any normed space E’. (First, prove formulas analogous to 
Problem 6 in Chapter 5, §1; use Note 3 in §1.) Finally, do it for the 
differential, df (p, - ). 


. In Note 1 of §4, express the matrices in terms of partials (see Theorem 4 


in §3). Invent a “variable” notation for such matrices, imitating Jaco- 
bians (Corollary 3). 


(i) Show that 
A(z, Y, z) 2 
OF, 8; @) 
if 
x=rcosé, 


y =rsin@ sina, and 


z=?7Tcosa 


FIGURE 27 
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(This transformation is passage to polars in E%; see Figure 27, 
where r = OP, {<XOA = 60, and <AOP = a.) 


(ii) What if = rcos@, y = rsin@, and z = z remains unchanged 
(passage to cylindric coordinates)? 


(iii) Same for x = e” cos, y =e" sin@, and z = z. 


. Is f = (fi, fo): E? — E? one-to-one or bijective, and is Jy # 0, if 


(i) fi(z,y) = e* cosy and fo(z, y) = e* siny; 
(ii) fi(a,y) =a? —y? and fo(x,y) = 2ay? 
Define f: E* — E? (or C® — C?) by 


f(z) = is ee 


3 
A= {é ee -1} 
k=1 
and f = 0 on —A. Prove the following. 
(i) f is one-to-one on A (find f~'!). 


1 
(i) J,(@) = | 
+ ae wp)” 
(iii) Describe —A geometrically. 


> 


x 


on 


Given any sets A, B and maps f,g: A— E’,h: E’ > E,andk: B— A, 
prove that 


(i) (ftg9)ok=foktgok, and 
(ii) ho(f+g)=hof+hog if h is linear. 
Use these distributive laws to verify that 
¢'o(0-¢)ot'=¢'-e! 
in Corollary 3. 
[Hint: First verify the associativity of mapping composition.] 
Prove that if ¢: E’ — E is linear and one-to-one, so is ¢~!: E” > E’, 
where BE” = @|E’]. 
Let v1,...,0, be the column vectors in det[¢]. Prove that det|é] turns 
into 
(i) c- det|¢] if one of the v, is multiplied by a scalar c; 


(ii) — det[¢], if any two of the v;, are interchanged (consider X in for- 
mula (1)). 
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Furthermore, show that 
(iii) det|¢] does not change if some v, is replaced by vj, + cv; (i F k); 


(iv) det[¢] = 0 if some &% is 0, or if two of the % are the same. 


§7. Inverse and Implicit Functions. Open and Closed Maps 


I. “If f € CD! at p, then f resembles a linear map (namely df) at p.” Pursuing 


this basic idea, we first make precise our notion of “f € CD! at p. 
Definition 1. 


A map f: E’ > E is continuously differentiable, or of class CD* (written 
f € CD), at p iff the following statement is true: 


Given any ¢ > 0, there is 6 > 0 such that f is differentiable on the 
globe G = G,(6), with 


lldf(Z, -) -— df, -)|| <e forall eG! 


By Problem 10 in 85, this definition agrees with Definition 1 of §5, but is no 
longer limited to the case E’ = E" (C”). See also Problems 1 and 2 below. 
We now obtain the following result. 
Theorem 1. Let E’ and E be complete. If f: E’ > E is of class CD' at p 
and if df(p, -) is bijective (§6), then f is one-to-one on some globe G = Gix(6). 
Thus f “locally” resembles df(p, -) in this respect. 
Proof. Set ¢ = df(p, -) and 


=e 
le "== 
& 


(cf. Theorem 2 of §6). 
By Definition 1, fix 6 > 0 so that for 7 € G = Gj(6). 


Z 1 
llaF(z, -) — oll < Se. 
Then by Note 5 in §2, 
_ 1 
(1) (VEG) (VUE) |df(z,a) -— o(@)| < ae lil: 
Now fix any 7,S¢ G, F #8, and set T=7—FF0. Again, by Note 5 in §2, 


li] = |2-* (OC) < [lO *"NN16(@)| = =|9(W)| 


' We can always make G closed by reducing 6. 
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(2) 0 < elt] < |o(a)|. 
By convexity, G D I = L[s,r), so (1) holds for FE 1, F=F+tt,O<t <1. 
Noting this, set 


Then for 0 <t< 1, 


(Verify!) Thus by (1) and (2), 


sup |h'(t)| = sup |df(s+ tu; a) — 6(u)| 
0<t<1 0<t<1 


As h(0) = Sand 
h(1) = f(§+ a) — ot) = f(r) — o@), 
we obtain (even if 7 = 3) 
(3) f(r) — F(8) — o(@)| < 
But by the triangle law, 
|o(@)| — Ff) — FI < lf) — £8) - o@). 


Thus 

4 Le oie dl ef Te sey 
(4) IP) = £9) = $16 = selitl = Sel? 51 
by (2). 


Hence f(7) # f(5) whenever 7 4 5 in G; so f is one-to-one on G, as 
claimed. 


Corollary 1. Under the assumptions of Theorem 1, the maps f and f—+ (the 
inverse of f restricted to G) are uniformly continuous on G and f|G], respec- 
tively. 
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Proof. By (3), 
e = Lega 
If) — FS) Ss 1o@| + slo 
< [2 6)| 
< 2\|¢|| lal 
=2llel|lrF-s| @ Fe G). 
This implies uniform continuity for f. (Why?) 
Next, let g = f-' on H = f |G). 
If zy € H, let 7 = g(Z) and & = g(y); so 7,8 € G, with # = f(r) and 
i= f(@). Hence by (4), 


lf - a1 > Slo(#) - 90) 


proving all for g, too. 


Again, f resembles @ which is uniformly continuous, along with o~!. 


II. We introduce the following definition. 
Definition 2. 


A map f: (5,p) — (T,p’) is closed (open) on D C S iff, for any X C D 
the set f[X] is closed (open) in T whenever X is so in S. 


Note that continuous maps have such a property for inverse images (Prob- 
lem 15 in Chapter 4, §2). 


Corollary 2. Under the assumptions of Theorem 1, f is closed on G, and so 


the set f|G] is closed in E. 

Similarly for the map f~' on f[G@]. 
Proof for E’ = E = E"(C”) (for the general case, see Problem 6). Given 
any closed X C G, we must show that f[X] is closed in E. 

Now, as G is closed and bounded, it is compact (Theorem 4 of Chapter 4, §6). 

So also is X (Theorem 1 in Chapter 4, 86), and so is f[X] (Theorem 1 of 
Chapter 4, §8). 

By Theorem 2 in Chapter 4, §6, f[X] is closed, as required. 


For the rest of this section, we shall set E’ = E = E" (C”). 


Theorem 2. [f E’ = E = E"(C") in Theorem 1, with other assumptions 
unchanged, then f is open on the globe G = G(6), with 5 sufficiently small.” 


We first prove the following lemma. 


? Thus formula (1) still holds for ¢ = 1/||¢~1||, ¢ = df (@, -). 
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Lemma. f[G] contains a globe Gz(a) where ¢= f(p). 
Proof. Indeed, let 
1 
a= rae 
where 6 and ¢€ are as in the proof of Theorem 1. (We continue the notation 


and formulas of that proof.) 
Fix any € € Gj(a); so 


1 
Je—q] <a= je. 


Set h =|f —¢| on E’. As f is uniformly continuous on G, so is h. 
Now, G is compact in E" (C”); so Theorem 2(ii) in Chapter 4, §8, yields a 
point 7’ € G such that 


(6) h(7’) = min h{G}. 


We claim that 7 is in G (the interior of G). 
Otherwise, |7 — p] = 6; for by (4), 


(7) <| fF) - 4+ |2- fH) 
= h(?) + h(p). 
But 
h(p) = |é— f(p)| = |€- dl < a; 
and so (7) yields 
h(p) <a < h(r), 


contrary to the minimality of h(7) (see (6)). Thus |7— p] cannot equal 6. 

We obtain |r — p| < 6, so r € G5(d) = G and f(r) € f[G]. We shall now 
show that ¢= f(7). 

To this end, we set ¢ = @— f (7) and prove that o = 0. Let 


where 
as before. Then 


With 7 as above, fix some 
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with ¢t so small that 5 € G also. Then by formula (3), 


If) — F — o6@)] < 5 lea 


also, 
If (7) — &+ g(tu)| = (1 —4)|d] = (1 — t)h(r) 


> 


by our choice of ¥,u and h. Hence by the triangle law, 
1 
n(3) =F) — a < (1- St), 
(Verify!) 
As 0 <t <1, this implies h(7’) = 0 (otherwise, h(5) < h(7), violating (6)). 
Thus, indeed, 
|e] = |f(F) — ed =0, 
Le., 
cé=f(ryeflG| forrec. 


But ¢ was an arbitrary point of G7(a). Hence 


Gea) C FIG], 


proving the lemma. 


Proof of Theorem 2. The lemma shows that f(j) is in the interior of f[G| 
if p, f, df(p, -), and 6 are as in Theorem 1. 

But Definition 1 implies that here f € CD! on all of G (see Problem 1). 

Also, df (#, -) is bijective for any Z € G by our choice of G and Theorems 1 
and 2 in 86. 

Thus f maps all £ € G onto interior points of f/G]; i.e., f maps any open 
set X C G onto an open f[X], as required. 


Note 1. A map 
f: (S,p) —> (T,") 


is both open and closed (“clopen” ) iff f~! is continuous—see Problem 15(iv)(v) 
in Chapter 4, §2, interchanging f and f~!. 

Thus ¢ = df(p, -) in Theorem 1 is “clopen” on all of E’. 

Again, f locally resembles df (7p, - ). 


III. The Inverse Function Theorem. We now further pursue these ideas. 
Theorem 3 (inverse functions). Under the assumptions of Theorem 2, let g 
be the inverse of fg (f restricted to G = Gj(0)). 

Then g € CD! on f[G] and dg(¥, -) is the inverse of df (Z,-) whenever 
x= g9(¥), EG. 
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Briefly: “The differential of the inverse is the inverse of the differential.” 
Proof. Fix any ¥ € f[G] and Z% = g(y); so ¥ = f(#) and FE G. Let U = 
df (Z, -). 

As noted above, U is bijective for every  € G by Theorems 1 and 2 in 86; 
so we may set V = U~'. We must show that V = dg(7, -). 

To do this, give ¥ an arbitrary (variable) increment Ay, so small that 7+ Ay 
stays in f{G] (an open set by Theorem 2). 

As g and fg are one-to-one, Ay uniquely determines 


Az = (G+ AY) — 9H) =, 
and vice versa: 
Ag = f(€+#)- f@) 
Here Aj and ¢ are the mutually corresponding increments of ¥ = f(Z) and 
# = g(y). By continuity, 7 > 0 iff fF 0.8 


As U = df(z, -), 
Lim Hise t) — f() — U(®| =0, 
i 
(8) lm LP @)| =O. 
where 
(9) F@) = f(@+d -f®-U. 
As V = U—!, we have 
V(U(E)) =t= 9(¥ + AY) - 99) 
So from (9), 
V(F(@)) = V(Ag) -€ 
= V(Ay) — [9+ Ay) — oy); 
that is, 
00) ealat+ an -a-Vianl=EO" ages 


Now, formula (4), with 7 = 7%, f= %+t, an 


3 This change of variables is admissible as the map f —~ Aj is one-to-one (Corollary 2 in 
Chapter 4, §2). 
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i.e., [Ag] > de|é]. Hence by (8), 


VFO) - VFO! _ 2 
|Aj| ~ dele] e 


1 2 1 — 
v( FO)|< ZIVIGIFO| 0a 75 
E 


2] Z 
Since tf > 0 as Ay — O (change of variables!), the expression (10) tends to 
0as Ag > 0. 
By definition, then, g is differentiable at 7, with dg(y,-) =V =U7!. 
Moreover, Corollary 3 in §6, applies here. Thus 
(V5 >0) (46">0) ||U-W| <6” > |U1t-wt| <6. 


Taking here U~! = dg(y, -) and W~! = dg(¥+ Ay), we see that g € CD! near 
y. This completes the proof. 


Note 2. If E’ = EF = E” (C”), the bijectivity of ¢ = df (p, - ) is equivalent to 


det[¢] = det[f"(p)] 4 0 


(Theorem 1 of §6). 
In this case, the fact that f is one-to-one on G = G(d) means, componentwise 
(see Note 3 in §6), that the system of n equations 


$0) =F Ginseng) HO, TH ch, 
has a unique solution for the n unknowns zx; as long as 
(Y15--+5 Ym) =VE FIG]. 
Theorem 3 shows that this solution has the form 
e— Gel), B=1pseiah, 

where the gj, are of class CD! on f[G] provided the f; are of class CD! near > 
and det [f’(p)| 4 0. Here 

det[f"(p)] = Js (P), 
as in 86. 

Thus again f “locally” resembles a linear map, ¢ = df (jf, -). 


IV. The Implicit Function Theorem. Generalizing, we now ask, what 


about solving n equations inn +m unknowns %1,..-,2%n,Y1,---;Ym? Say, we 
want to solve 
(11) feltig<ies Castine nte) HO, FHL 2h 


for the first n unknowns (or variables) x;, thus expressing them as 


Re HHA ieee tale BH Tysen st 
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with H,: Bb +E" or H,:C™ —C. 
Let us set £ = (21,...,2n), ¥ = (Y1,---, Ym), and 
(9) = iisacs oa Vises Oia) 
so that (7,7) € EP*™ (C™™™), 
Thus the system of equations (11) simplifies to 
felZ, 7) = 9, = 1.54454 
or 
f(@,9) =, 
where f = (fi,.--, fn) is a@ map of E™t™ (C™'™) into E” (C™); f is a function 
of n+ ™ variables, but it has n components fy; 1.e., 
FOG) =F isso Cacti stn) 
is a vector in E” (C™). 
Theorem 4 (implicit functions). Let EB! = E™*™ (C"t™), E = E" (C™), and 
let f: E' > E be of class CD! near 
(0,9) = (Pi,---,PnsM1---,4m), PE E"(C”), Ge E™(C™). 
Let [¢] be the n x n matrix 
(OPO). 9S eo 
If det[d] 4 0 and if f(@,q@) =0, then there are open sets 
PC E"(C") and QC E™ (0), 
with p € P and g € Q, for which there is a unique map 
HA: Q-P 
with . 
f(A), ¥) = 0 
for all 7 € Q; furthermore, H € CD' on Q. 
Thus # = H(y) is a solution of (11) in vector form. 
Proof. With the above notation, set 
F(@,9)=(f@,9),9), Fi BO EB. 
Then 
FRO) = (09,9 = 0,0, 


since f (p,q) = 0. 
As f € CD! near (p,q), so is F (verify componentwise via Problem 9(ii) in 
83 and Definition 1 of §5). 
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By Theorem 4, §3, det|F’(p, @)] = det|¢] 4 0 (explain!). 
Thus Theorem 1 above shows that F’ is one-to-one on some globe G about 
(Pq). 


Clearly G contains an open interval about (p,@). We denote it by P x Q 
where p € P, g€ Q; P is open in E” (C”) and Q is open in E™ (C™).4 
By Theorem 3, Fpxg (F restricted to P x Q) has an inverse 


g: Ac> Px Q, 


where A = F[P x Q] is open in E’ (Theorem 2), and g € CD! on A. Let 


the map u = (g1,---,9n) comprise the first n components of g (exactly as f 
comprises the first n components of F’). 
Then 


g(&, y) _ (u(Z, y); y) 


exactly as F(z, ¥) = (f(Z,9),¥). Also, u: A — P is of class CD! on A, as g is 
(explain!). 
Now set 


here y € Q, while 
(0,9) «A= FIP x Q], 


for F preserves ¥ (the last m coordinates). Also set 


Then f = ao F (why?), and 


fHG).D) = f(u(0,9), 7) = £(G(0,9)) = a(F (90, 9)) = a0, 7) = 0 


by our choice of a and g (inverse to F’). Thus 


as desired. 
Moreover, as H(i) = u(0, 7), we have 


OYs 


As u € CD', all Ou/Oy; are continuous (Definition 1 in §5); hence so are the 
OH/Oy;. Thus by Theorem 3 in §3, H € CD! on Q. 


4 This can be made more precise using the theory of product spaces (Chapter 4, *§11). 
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Finally, H is unique for the given P, Q; for 


feu) =6 


Thus f(Z, 7) = 0 implies = H(¥); so H(¥) is the only solution for Z. 


Note 3. H is said to be implicitly defined by the equation f(Z,7) = 0. In 


this sense we say that H(i) is an implicit function, given by f(z, ¥) = 0. 


1 II 


Similarly, under suitable assumptions, f(Z, 7) = 0 defines 7 as a function 
of Z. 

Note 4. While 7 is unique for a given Y 
neighborhood P x Q of (p, ¢), another im- 
plicit function may result if P x Q or (j, g) 


is changed. 


For example, let 
fa) =2° 49" =25 


(a polynomial; hence f € CD! on all of 
E*). Geometrically, 2? + y? — 25 = 0 de- 
scribes a circle. 


FIGURE 28 


Solving for x, we get 7 = +,/25 — y?. Thus we have two functions: 


Ay(y) = +25 — y? 
and 


Aa(y) = —V/25 — y?. 


If P x Q is in the upper part of the circle, the resulting function is H,. Other- 
wise, it is Hp. See Figure 28. 


V. Implicit Differentiation. Theorem 4 only states the existence (and 
uniqueness) of a solution, but does not show how to find it, in general. 

The knowledge itself that H € CD! exists, however, enables us to use its 
derivative or partials and compute it by implicit differentiation, known from 
calculus.® 


5 For more on implicit differentiation, see §10. 
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Examples. 


(a) 


Let f(x,y) = x7 + y? — 25 =0, as above. 

This time treating y as an implicit function of x, y = H(«), and writing 
y’ for H'(x), we differentiate both sides of x? + y? — 25 = 0 with respect 
to x, using the chain rule for the term y? = [H(x)]?. 

This yields 2a + 2yy’ = 0, whence y’ = —2/y. 

Actually (see Note 4), two functions are involved: y = +V25 — x2; but 
both satisfy x? + y? — 25 = 0; so the result y’ = —2/y applies to both. 


Of course, this method is possible only if the derivative y’ is known to 
exist. This is why Theorem 4 is important. 


Let 
f(z,y,z) =a? +y?+22-1=0, z,y,z € BE}. 


Again f satisfies Theorem 4 for suitable x, y, and z. 


Setting z = H(z,y), differentiate the equation f(x,y, z) = 0 partially 


with respect to x and y. From the resulting two equations, obtain ge 


and on 
Problems on Inverse and Implicit 
Functions, Open and Closed Maps 
. Discuss: In Definition 1, G can equivalently be replaced by G = G'p(6) 


(an open globe). 


. Prove that if the set D is open (closed) in (S,p), then the map f: S > T 


is open (closed, respectively) on D iff fp (f restricted to D) has this 
property as a map of D into f|D}. 
[Hint: Use Theorem 4 in Chapter 3, §12.] 


. Complete the missing details in the proofs of Theorems 1-4. 


3’ Verify footnotes 2 and 3. 


4’. 


. Show that a map f: EL’ — E may fail to be one-to-one on all of E’ even 


if f satisfies Theorem 1 near every p € E’. Nonetheless, show that this 
cannot occur if BE’ = E = E!. 


[Hints: For the first part, take E’ = C, f(x+iy) = e*(cosy+isiny). For the second, 
use Theorem 1 in Chapter 5, §2.] 


(i) For maps f: E!' — E!, prove that the existence of a bijective 
df(p, -) is equivalent to f’(p) 4 0. 


(ii) Let 
f(t) =a4+2° sin =, f(0) =0. 


Show that f’(0) 4 0, and f € CD! near any p # 0; yet f is not 
one-to-one near 0. What is wrong? 
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10. 


11. 


12. 
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. Show that a map f: E”(C") — E"(C™), f € CD, may be bijective 


even if det[f’(p)| = 0 at some p, but then f~! cannot be differentiable 
at T= f(P). 

[Hint: For the first clause, take f(a) = x3, p = 0; for the second, note that if f—1 is 
differentiable at J, then Note 2 in §4 implies that det[df(p, -)|-det[df—1(g -)) =14 
0, since f o f~! is the identity map.] 


. Prove Corollary 2 for the general case of complete E’ and E. 


[Outline: Given a closed X C G, take any convergent sequence {Yn} C f[X]. By 
Problem 8 in Chapter 4, §8, f—!(%n) = €n is a Cauchy sequence in X (why?). By 
the completeness of E’, (AZ € X) , — £ (Theorem 4 of Chapter 3, §16). Infer that 
lim jn = f(£) € f[X], so f[X] is closed.] 


. Prove that “the composite of two open (closed) maps is open (closed).” 


State the theorem precisely. Prove it also for the uniform Lipschitz 
property. 


. Prove in detail that f: (S,p) — (T,p’) is open on D C S iff f maps the 


interior of D into that of f[D]; that is, f[D°] C (f[D])°. 


. Verify by examples that f may be: 


(i) closed but not open; 
(ii) open but not closed. 


(Hints: (i) Consider f = constant. (ii) Define f: BE? — E+ by f(x,y) = 2 and let 
1 
D= {(x,y) € B?|y= 3 x > 0h; 
x 


use Theorem 4(iii) in Chapter 3, §16 and continuity to show that D is closed in 
E?, but f[D] = (0,+00) is not closed in E'. However, f is open on all of E? by 
Problem 8. (Verify!)] 


Continuing Problem 9(ii), define f: E” — E! (or C” = C) by f(#) = 
x, for a fixed k < n (the “kth projection map”). Show that f is open, 
but not closed, on E” (C”). 
(i) In Example (a), take (p,q) = (5,0) or (—5,0). Are the conditions 
of Theorem 4 satisfied? Do the conclusions hold? 
(ii) Verify Example (b). 
(i) Treating z as a function of x and y, given implicitly by 
f(a,yz)=2+ac*—-yz=0, fi BoB, 
discuss the choices of P and Q that satisfy Theorem 4. Find ge 
and 3. 
(ii) Do the same for f(z, y, z) = e74* —1=0. 


. Given f: E"(C") — E™(C™), n > m, prove that if f € CD! ona 
globe G, f cannot be one-to-one. 
[Hint for f: E? — E!: If, say, Dif 40 on G, set F(x, y) = (f(z, y),y).] 
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14. 


15. 


16. 


17. 


18. 


Suppose that f satisfies Theorem 1 for every p in an open set A C E’, 
and is one-to-one on A (cf. Problem 4). Let g = f,' (restrict f to A 
and take its inverse). Show that f and g are open and of class CD! on 
A and f|Al], respectively. 
Given U € E and a scalar c £ 0, define Tz: E — E (“translation by v”) 
and M.: E — E (“dilation by c”), by setting 
T3(Z) = +0 and M,(Z) = cz. 
Prove the following. 
(i) Ty and t= T_s) are bijective, continuous, and “clopen” on E; 
so also are M, and M>1(= M1;-). 
(ii) Similarly for the Lipschitz property on E. 
(iii) If G = G7(d) C E, then T;[G] = Gz40(d), and M.[G] = Geg(|cd]). 
(iv) If f: E’ — E is linear, and v = f(p) for some p € E’, then 
Tyo f = foT; and M.o f = fo M2, where T% and M; are the 
corresponding maps on E’. If, further, f is continuous at 7, it is 
continuous on all of E’. 
[Hint for (iv): Fix any # € E’. Set d= f(€—-p),g=Tzo fo Tg Verify 
that g = f, Th (2) = p, and g is continuous at Z.] 
Show that if f: E’ — E is linear and if f[G*] is open in EF for some 
G* = G;(6) C E’, then 
(i) f is open on all of E’; 
(ii) f is onto E. 


[Hints: (i) By Problem 8, it suffices to show that the set f[G] is open, for any globe 
G (why?). First take G = Gg(d). Then use Problems 7 and 15(i)—(iv), with suitable 
v and c. 

(ii) To prove EF = f[E"], fix any ¥ € E. As f = Gg(4) is open, it contains a globe 
G' = G(r). For small c, c¥ € G’ C f[E’]. Hence ¥ € f[E’] (Problem 10 in §2).] 
Continuing Problem 16, show that if f is also one-to-one on G*, then 


fu! 7 E, 
f € L(E’,E), f-' € L(E, E’), f is clopen on E', and f—! is so on E. 
[Hints: To prove that f is one-to-one on E’, let f(Z) = f(z’) = ¥ for some Z, #’ € E’. 
Show that 
(Ac,e>0) cf € Gee) C f[G5(5)] and f(ce + p) = f(cz" +p) € FIGp(9)] = FIG"). 


Deduce that c# +p = cx’ + p and £ = Z’. Then use Problem 15(v) in Chapter 4, §2, 
and Note 1.] 


A map 
fi (S,p) —> (L,¢) 
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is said to be bicontinuous, or a homeomorphism, (from S onto T) iff 
both f and f~! are continuous. Assuming this, prove the following. 

(i) t, > pin S iff f(t») > f(p) in T; 

(ii) A is closed (open, compact, perfect) in S iff f[A] is so in T; 

(iii) B= Ain S iff f[B] = f[A] in T; 

(iv) B= A° in S iff f[B] = (f[A])° in T; 

(v) A is dense in B (ie., AC BC ACS) in (S,p) iff f[A] is dense in 

f[B] (7, 6"). 

[Hint: Use Theorem 1 of Chapter 4, §2, and Theorem 4 in Chapter 3, §16, for closed 
sets; see also Note 1.] 


19. Given A,B C EB, v © E and a scalar c, set 
A+0={#4+0|£EA} andcA={cF%| FEA}. 

Assuming c 4 0, prove that 

(i) A is closed (open, compact, perfect) in E iff cA + @ is; 

(ii) B= Aiff cB+0=cA4t+i; 

(iii) B= A° iff eB+v=(cA+7)9; 

(iv) A is dense in B iff cA + V is dense in cB + Uv. 
[Hint: Apply Problem 18 to the maps T; and Mz of Problem 15, noting that A+¢@ = 
Ts[A] and cA = M.[A]]] 


20. Prove Theorem 2, for a reduced 6, assuming that only one of E’ and E 
is E” (C”), and the other is just complete. 


[Hint: If, say, E = E” (C™), then f[G] is compact (being closed and bounded), and so 
is G = f—1[f[G]]. (Why?) Thus the Lemma works out as before, i.e., f[G] D Gz(a). 

Now use the continuity of f to obtain a globe G’ = Gj(6’) C G such that 
f[G’] C Gz(a). Let g = ae further restricted to Gz(a). Apply Problem 15(v) in 
Chapter 4, §2, to g, with S = Gg(a), T = E’ |] 
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We pause to outline the theory of so-called sets of Category I or Category II, 
as introduced by Baire. It is one of the most powerful tools in higher analysis. 
Below, (S,p) is a metric space. 
Definition 1. 
A set A C (S,p) is said to be nowhere dense (in S) iff its closure A has 
no interior points (i-e., contains no globes): (A)° = 0. 
Equivalently, the set A is nowhere dense iff every open set G* A 0 in 
S contains a globe G disjoint from A. (Why?) 
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Definition 2. 
A set A C (S,p) is meagre, or of Category I (in S), iff 


A= v fa 
n=1 


for some sequence of nowhere dense sets Ay. 
Otherwise, A is said to be nonmeagre or of Category II. 
A is residual iff —A is meagre, but A is not. 


Examples. 

(a) @ is nowhere dense. 

(b) Any finite set in a normed space F is nowhere dense. 
(c) The set N of all naturals in E! is nowhere dense. 
) 


(d) So also is Cantor’s set P (Problem 17 in Chapter 3, §14); indeed, P is 
closed (P = P) and has no interior points (verify!), so (P)° = P® = 0. 


(ec) The set R of all rationals in E' is meagre; for it is countable (see Chap- 
ter 1, §9), hence a countable union of nowhere dense singletons {r,}, 
rn € R. But R is not nowhere dense; it is even dense in E!, since R = E! 
(see Definition 2, in Chapter 3, §14). Thus a meagre set need not be 
nowhere dense. (But all nowhere dense sets are meagre—why’) 


Examples (c) and (d) show that a nowhere dense set may be infinite (even 
uncountable). Yet, sometimes nowhere dense sets are treated as “small” or 
“negligible,” in comparison with other sets. Most important is the following 
theorem. 


Theorem 1 (Baire). In a complete metric space (S,p), every open set G* 4 0) 
is nonmeagre. Hence the entire space S' is residual. 


Proof. Seeking a contradiction, suppose G* is meagre, i.e., 


C= U An 


for some nowhere dense sets A,. Now, as A; is nowhere dense, G* contains a 
closed globe 


Gi = Gy, (61) C —Ar. 


Again, as Ag is nowhere dense, G, contains a globe 


ae, ee 1 
Go = Gus (52) Cc — Ap, with 0 < do < 3 ot 
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By induction, we obtain a contracting sequence of closed globes 


1 
Gn = Ge, (in), with O<dn < 561 0. 


As S is complete, so are the G,, (Theorem 5 in Chapter 3, 817). Thus, by 
Cantor’s theorem (Theorem 5 of Chapter 4, §6), there is 


[o@) 
DE () Cx 
n=1 


As G* D G,, we have p € G*. But, as G, C —An, we also have (Vn) p ¢ An; 
hence 


p¢ LJ An=@ 


n=1 


(the desired contradiction!). 


We shall need a lemma based on Problems 15 and 19 in 87. (Review them!) 
Lemma. Let f ¢ L(E’,E), E’ complete. Let G = Ga(1) be the unit globe in 


E’. If f[G| (closure of f[G] in E) contains a globe Go = Go(r) C E, then 
Go C f |G). 

Note. Recall that we “arrow” only vectors from E’ (e.g., 0), but not those 
from E (e.g., 0). 
Proof of lemma. Let A = f[G]M Go C Go. We claim that A is dense in 
Go; i-e., Go C A. Indeed, by assumption, any q € Go is in f[G]. Thus by 
Theorem 3 in Chapter 3, §16, any G, meets f[G] 1 Go = A if ¢ € Go. Hence 


(¥VgEGo) qeEA 


ie., Go C A, as claimed. 
Now fix any go € Go = Go(r) and a real c (0<c< 1). As A is dense in Go, 
A M Gq, (cr) a 0; 
so let gq, € AN G,,(er) C f[G]. Then 


lai —@ol <cr, qo € Gq (cr). 


As qm € f[G], we can fix some p; € G = Go(1), with f(pi) = qm. Also, by 
Problems 19(iv) and 15(iii) in §7, cA+q is dense in cGp + qi = Gy, (cr). But 
go € Gq, (cr). Thus 
Gq (Cr) (cA +m) #9; 
so let go € Gq, (c?r) M (cA + qi), 80 Go € Gq, (C?r), ete. 
Inductively, we fix for each n > 1 some gn € Ga, (c"r), with 


Gn © cA =F dn-1; 
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Le., 
Qn — AIn-1 © oe NA, 


As AC f[Go(1)], linearity yields 
dm — In-1 € fle” Go(1)] = f[Go(e"™")],_ n> 1. 


Thus for each n > 1, there is Pp, € Go(c"~*), (ie., |Dn| < c+) such that 
f (Pn) = dn — Qn—1. Now, as |p;,| < c*-1 and0O<c<1, 


S> \Dn| < +00; 
1 


so by the completeness of E’, >, converges in E’ (Theorem 1 in Chapter 4, 
§13). Let p= >>?" De; then 


f(p) = f( jim. ry) = lim, #( Sm) 
k=1 k=1 
= lim D7 f (Pe) for f ¢ L(E", E). 
k=1 


But f(ie) = de — de-1 (Kk > 1), and f(p1) = qm; so 


Y_ f@e) =a + 5 Ge — Ge-1) = an 


k=1 k=2 


Thus 
FP) = im, YFG) = im. ao = a! 
k=1 
Moreover, |p| < c*~+ (k > 1). Thus 
[o.e) co 1 
~ k-1 _ 


Le., 


ae Ga(; ~ 3): 
But go = f(p); so 
me s{ee( 2} 


1 Note that gn — qo, since gn € Gago (e"r) implies |an — go| < e"r > 0, asO<e< 1. 
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As qo € Go(r) was arbitrary, we have 


cut < [6o(-4)} 


or by linearity, 
Go(r(1—¢)) € f[Go(1)] = FGI. 
This holds for any c € (0,1). Hence 


fGI2 LU Golr(a—e)) =Go(r). (Verify!) 


O0<c<l 


Thus all is proved. 


We can now establish an important result due to S. Banach. 


Theorem 2 (Banach). Let f € L(E’,E), with E’ complete. Then f|E"| is 
meagre in E or f[E"| = E, according to whether f|Gg(1)| ts or is not nowhere 
dense.” 


Proof. If f[Go(1)] is nowhere dense in E, so also is f[Go(n)], n > 0. (Verify 
by Problems 15 and 19 in §7.) But then 


fe = £]U Gat] = U fest) 


is a countable union of nowhere dense sets, hence meagre, by definition. 

Now suppose f[Gg(1)] is not nowhere dense; so f[Gg(1)] contains some 
Gy(r) C E. We may assume q € f[Ga(1)] (if not, replace q by a close point 
from f[Gg(1)]). Then ¢ = f(p) for some p € Gg(1). The latter implies 

| — Pl = |p) = (,0) <1; 
so 
G_p(1) S G52). 


Also, as f[Gg(1)] > Ga(r), translation by —¢ = f(—p) yields 
f(Gg()] + F(-P) 2 Ga(r) — a = Gol(r), 


Le., 


Go(r) © f[G_p(1)] S FIGGQ2)]- 
Hence f[Gg(1)] 2 Go($r) (why?); so, by the Lemma 


(1) fIG5(4)] 2 Go(5r) in B. 


? Of course, if E is meagre, so is f[E’] in both cases. 


*88. Baire Categories. More on Linear Maps 75 


This implies f[G5(2n)] 2 Go(nr), and so 


f[EV2 LJ Golnr) = £, 


n=1 


ie., f[E"] = E, as required. Thus the theorem is proved. 


Theorem 3 (Open map principle). Let f € L(E", FE), with E’ and E complete. 
Then the map f is open on E" iff f[E’) = E, i.e., iff f is onto E. 

Proof. If f{E’] = E, then by Theorem 1, f[E"’] is nonmeagre in E, as is E 
itself. Thus by Theorem 2, f[Gg(1)] is not nowhere dense, and (1) follows as 
before. Hence by Problems 15(iii) and 19 in §7, f[Gs] > some G, whenever 
q= f(p). (Why?) Therefore, Gz C A C E’ implies 


Gp) S FIGzp] S FIA]; 
i.e., f maps any interior point p € A into such a point of f{A]. By Problem 8 
in §7, f is open on E’. 
Conversely, if so, then f[E’] is an open set 4 J in E, a complete space; so by 
Theorems 1 and 2, f{E’] is nonmeagre and equals EF. (See also Problem 16(ii) 
in §7.) 


Note 1. Theorem 3 holds even if f is not one-to-one. 


Note 2. If in Theorem 3, however, f is bijective, it is open on EF’, and 
so f-! € L(E,E’) by Note 1 in 87. (This is the promised general proof of 
Corollary 2 in §6.) 


Theorem 4 (Banach-Steinhaus uniform boundedness principle). Let E’ be 
complete. Let N be a family of maps f € L(E’, E) such that 


(2) (Va eC BE’) (AKC E') (VFEN) |f(X®|<k. 


(“N is bounded at each Z.”) 
Then N is “norm-bounded,” i.e., 


(AK eB!) (WfeEN) If <K, 


with || || as in §2. 
Proof. It suffices to show that NV is “uniformly” bounded on some globe, 


(3) (Ace E’) (AG =Gp(r)) VWF EN) (VFEG) |f(Z@l| <e. 


For then |Z — p] < r implies 


2c > |f(@) — f@)| = |f@— PH, 


or (setting #— p= ry) |y| < 1 implies 


WEEN) [FMI <= (why?) 
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sO 


WFEN) IIs sup FOI < = 


Thus, seeking a contradiction, suppose (3) fails and assume its negation: 
(4) (Wee BE) VG=Ge(r)) SEN) GFEG=G4z(r)) [f@l>e. 
Then for c = 1, we can fix some f; € NV and Gz, (r1) such that 0 <r; < 1 and 

|fi(%1)| > 1. 
By the continuity of the norm | |, we can choose r; so small that 
(V@EGz,(ri)) [F(Z] >1. 
Again by (4), we fix fg € N and #2 € Gz, (ri) such that | fo| > 2 on some globe 
Gz, (ra) c Gz, (r1), 


with 0 < rg < 1/2. Inductively, we thus form a contracting sequence of closed 
globes 


——__~ 1 
Gz, (Tn), 0O<Tn< ais 
n 
and a sequence {f,,} C NV, such that 
(Vn) |fn| > non Gz, (tn) CE’. 
As E" is complete, so are the closed globes Gz, (rn) C E’. Also, 0 < rn < 
1/n — 0. Thus by Cantor’s theorem (Theorem 5 of Chapter 4, 86), there is 
Zo — () Gz, (Tn). 
n=1 


As & is in each Gz, (rn), we have 


(Vn) |fn(#o)| > n; 
(2 


so N is not bounded at Zo, contrary to 
proof. 


). This contradiction completes the 


Note 3. Complete normed spaces are also called Banach spaces. 


Problems on Baire Categories and Linear Maps 


1. Verify the equivalence of the various formulations in Definition 1. Dis- 
cuss: A is nowhere dense iff it is not dense in any open set # @). 


2. Verify Examples (a) to (e). Show that Cantor’s set P is uncountable. 
[Hint: Each p € P corresponds to a “ternary fraction,” p = )>°°_, ¢n/3”, also written 


0.%1,%2,...,%n,..., where 2, = 0 or Z, = 2 according to whether p is to the left, 
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10. 


or to the right, of the nearest “removed” open interval of length 1/3”. Imitate the 
proof of Theorem 3 in Chapter 1, §9, for uncountability. See also Chapter 1, 89, 
Problem 2(ii).] 


Complete the missing details in the proof of Theorems 1 to 4. 


Prove the following. 


(i) If B C A and A is nowhere dense or meagre, so is B. 


(ii) If B C A and B is nonmeagre, so is A. 


[Hint: Assume A is meagre and use (i)).] 


(iii) Any finite union of nowhere dense sets is nowhere dense. Disprove 
it for infinite unions. 


(iv) Any countable union of meagre sets is meagre. 


. Prove that in a discrete space (5, :), only @ is meagre. 


[Hint: Use Problem 8 in Chapter 3, §17, Example 7 in Chapter 3, §12, and our 
present Theorem 1.] 


. Use Theorem 1 to give a new proof for the existence of irrationals in E!. 


(Hint: The rationals R are a meagre set, while E! is not.] 


What is wrong about this “proof” that every closed set F #4 0 in a 
complete space (S,/) is residual: “By Theorem 5 of Chapter 3, §17, F 
is complete as a subspace. Thus by Theorem 1, F' is residual.” Give 
counterexamples! 


. We call K a Gs-set and write K € Gs if K = ‘eae G,, for some open 


sets G,,.° 


(i) Prove that if K is a Gs-set, and if K is dense in a complete metric 
space (S,p), ie., K =S, then K is residual in S. 
[Hint: Let F, = —Gn. Verify that (Vn) Gy is dense in S, and F’, is nowhere 
dense. Deduce that —kK = —(|Gn =U Fn is meagre. Use Theorem 1.] 


(ii) Infer that R (the rationals) is not a Gs-set in E+ (cf. Example (c)). 


Show that, in a complete metric space (5,9), a meagre set A cannot 
have interior points. 
[Hint: Otherwise, A would obtain a globe G. Use Theorem 1 and Problem 4(ii).] 


(i) A singleton {p} C (S,p) is nowhere dense if S clusters at p; oth- 
erwise, it is nonmeagre in S (being a globe, and not a union of 
nowhere dense sets). 


(ii) If A C S clusters at each p € A, any countable set B C A is 
meagre in S. 


3 Such is any closed set A = A C (S,p) (see Problem 20 in Chapter 3, §16). 
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(i) Show that if @ # A € Gs (see Problem 8) in a complete space (S, p), 
and A clusters at each p € A, then A is uncountable. 


(ii) Prove that any nonempty perfect set (Chapter 3, §14) in a complete 
space is uncountable. 


(iii) How about R (the rationals) in E' and in R as a subspace of E+? 
What is wrong? 


(Hints: (i) The subspace (A,p) is complete (why?); so A is nonmeagre in A, by 
Problem 8. Use Problem 10(ii). (ii) Use Footnote 3.] 


If G is open in (S,:p), then G — G is nowhere dense in S. 
(Hint: G — G = Gn (—G) is closed; so 


(G —G) = (G-G)° = (Gn-G) =0 
by Problem 15 in Chapter 3, §12 and Problem 15 in Chapter 3, §16.] 
(“Simplified” uniform boundedness theorem.) Let f,: (S,p) — (T,p’) 
be continuous for n = 1,2,..., with S complete. If {f,,(x)} is a bounded 
sequence in T' for each x € S, then {f,,} is uniformly bounded on some 


open G # O: 
(Vp eT) (Sk) (Vn) (VreG) p'(p, frlx)) Sk. 
[Outline: Fix p € T and (Vn) set 
Fy = {2 € S| (Vm) n> pl(p, fn(a))}- 


Use the continuity of fm and of p’ to show that Fp is closed in S, and S =U", F, 
By Theorem 1, S' is nonmeagre; so at least one Fy, is not nowhere dense—call it F, 
so (F)° = F° £6. Set G = F° and show that G is as required.] 


Let fr: (S,e) — (T,p’) be continuous for n = 1,2,... Show that if 
fn — f (pointwise) on S, then f is continuous on S—Q, with Q meagre 
in S. 

[Outline: (Vk, m) let 


- U {reso (Fn (2), Fm(2)) > z}. 


By the continuity of p’, fn and fm, Apm is open in S. (Why?) So by Problem 12, 
UP _1(Akrm — Akm) is meagre for k = 1, 2,. 
Also, as fn — f on S, (\7>_, Akm = 9. (Verify!) Thus 


co 


(vk) a) Akm © Oe (Akm — Akm)- 
1 


(Why?) Hence the set Q = UR, 7-1 Akm is meagre in S. 
Moreover, S — Q = (VR, US°_1(—Akm)° by Problem 16 in Chapter 3, §16. 
Deduce that if p € S — Q, then 


(We > 0) (Amo) (AGp) (Vn,m > mo) (V@E Go) p!(fm(#); fn(@)) <e€ 
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Keeping m fixed, let n — oo to get 
(Ve > 0) (Amo) (AGp) (Vm = mo) (WHE Gp) p!(fm(x), f(@)) < e. 


Now modify the proof of Theorem 2 of Chapter 4, 812, to show that this implies the 
continuity of f at each pe S—Q,] 


§9. Local Extrema. Maxima and Minima 


We say that f: E’ — E* has a local mazimum (minimum) at p € E’ iff f (p) is 
the largest (least) value of f on some globe G about p; more precisely, iff 
(V@eG) Af= f(#)— fp) <0 (> 0). 

We speak of an improper extremum if we only have Af < 0 (> 0) on G. In 
any case, all depends on the sign of Af. 

From Problem 6 in 81, recall the following necessary condition. 
Theorem 1. [f f: E’ — E! has a local extremum at p then Def (p) = 0 for 
alli £0 in E’. 

In the case E' = E” (C™), this means that d'f (p, -) =0 on E’. 

(Recall that d' f (pt) = T2_, Def (B)te. It vanishes if the D;,f(p) do.) 

Note 1. This condition is only necessary, not sufficient. For example, if 
f(x,y) = xy, then d' f(0, -) =0; yet f has no extremum at 0. (Verify!) 

Sufficient conditions were given in Theorem 2 of §5, for E’ = E!. We now 
take up E’ = E?. 
Theorem 2. Let f: E? — E' be of class CD? on a globe G = G5(6). Suppose 
d' f (p, -) =0 on E?. Set A= Dis f (p), oe— Diof (p), and C = Doo f (p). 

Then the following statements are true. 

(i) If AC > B?, f has a marimum or minimum at p, according to whether 

A<OorA>0. 
(ii) If AC < B?, f has no extremum at p. 


The case AC = B is unresolved. 
Proof. Let Z€ Gand a@=#-pF 0. 
As d' f(p, -) =0, Theorem 2 in §5, yields 


Af =f(@) - f= Ri = 501 w), 


with 5 € L(p,#) C G (see Corollary 1 of §5). As f € CD?, we have Din f = 
Do, f on G (Theorem 1 in 85). Thus by formula (4) in 85, 


(1) A= 5OFG a) = F[Dus Gud + WDiaf(Surws + Deaf G3] 
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Now, as the partials involved are continuous, we can choose G = G'z(d) so 
small that the sign of expression (1) will not change if # is replaced by jp. Then 
the crucial sign of Af on G coincides with that of 


(2) D= Au? + 2Buju2 + Cus 


(with A, B, and C as stated in the theorem). 

From (2) we obtain, by elementary algebra, 
(3) AD = (Au; + Buz)? + (AC — B?)u2, 
(3') CD = (Cu, + Buz)? + (AC — B?)ui. 


Clearly, if AC > B?, the right-side expression in (3) is > 0; so AD > 0, 
i.e., D has the same sign as A. 

Hence if A < 0, we also have Af < 0 on G, and f has a maximum at p. If 
A> 0, then Af >0, and f has a minimum at p. 

Now let AC < B?. We claim that no matter how small G = G;(6), Af 
changes sign as X varies in G, and so f has no extremum at 7. 

Indeed, we have # = p+ i, @ = (uy, u2) 4 0. If ue = 0, (3) shows that D 
and Af have the same sign as A (A #0). 

But if ue #0 and wu; = —Bu2/A (assuming A ¥ 0), then D and Af have 
the sign opposite to that of A; and Z is still in G if ug is small enough (how 
small’). 

One proceeds similarly if C 4 0 (interchange A and C, and use (3’). 

Finally, if A = C = 0, then by (2), D = 2Buyuz and B # 0 (since AC < B?). 
Again D and Af change sign as u,uz does; so f has no extremum at p. Thus 
all is proved. 


Briefly, the proof utilizes the fact that the trinomial (2) is sign-changing iff 
its discriminant B? — AC is positive, i.e., | . ie | <0. 


Note 2. Functions f: C — E! (of one complex variable) are likewise cov- 
ered by Theorem 2 if one treats them as functions on E? (of two real variables). 


Functions of n variables. Here we must rely on the algebraic theory of so- 
called symmetric quadratic forms, i.e., polynomials P: E” — E! of the form 


Pig) SoD aajtatsz, 
j=l i=l 
where t = (ui,... , Un) € B” and aj; = aj; € E’. 


We take for granted a theorem due to J. J. Sylvester (see S. Perlis, Theory 
of Matrices, 1952, p. 197), which may be stated as follows. 
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Let P: E” — E! be a symmetric quadratic form, 


(i) P > 0 onall of E” — {0} iff the following n determinants Aj, are positive: 


aii 412 Qik 
aa1 a22 ee 9k 

(4) Ar = ; k=1,2,...,n. 
Ak1 Ak2 akk 


(ii) We have P <0 on E” — {0} iff (—1)* Ay > 0 fork =1,2,...,n 


Now we can extend Theorem 2 to the case f: E” > E'. (This will also 

cover f: C" — E!, treated as f: E?” — E!.) The proof resembles that of 
Theorem 2. 
Theorem 3. Let f: E" — E' be of class CD? on some G = Gp(5). Suppose 
df(p,-) =0 on E”. Define the Ag as in (A), with ay = Di f(p), 1,9,k <n. 
Then the following statements hold. 

(i) f has a local minimum at p if A, > 0 fork =1,2,.. 
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(ii) f has a local maximum at p if (—1)* A, > 0 fork =1,...,n 


(iii) f has no extremum at p if the expression 


P(t) = » x AjjUiU; 


j=l i=l 


is > 0 for some % € E” and < 0 for others (i.e., P changes sign on E”). 


Proof. Let again # € G, ¢ = £— p40, and use Taylor’s theorem to obtain 


(6) AF=f@-1H=M= 50160 = YY Dif 
jg=1 i=l 
with ¥€ L(z,p). 

As f € CD”, the partials D;; f are continuous on G. Thus we can make G so 
small that the sign of the last double sum does not change if 5’ is replaced by p. 
Hence the sign of Af on G is the same as that of P(@) = 07) Yj, qijuius, 
with the a;; as stated in the theorem. 

The quadratic form P is symmetric since aj; = a;; by Theorem 1 in 85. 
Thus by Sylvester’s theorem stated above, one easily obtains our assertions (i) 
and (ii). Indeed, they are immediate from clauses (i) and (ii) of that theorem. 
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Now, for (iii), suppose P(v%) > 0 > P(#), ie., 


n nm n 


SO SS aijusty; ee Re San for some u,v € E” — {0}. 


j=l i=1 j=l i=1 

If here & and ¥ are replaced by tu and tv (t # 0), then uju; and viv; turn 
into uu, and u,u;, respectively. Hence 

P(ti) = ??P(d@) > 0 > #P(#) = P(tv). 

Now, for any t € (0,6/|d|), the point % = p+ ti lies on the d-directed line 
through p, inside G = G5(d). (Why?) Similarly for the point z” = p+ tw. 

Hence for such # and z’, Taylor’s theorem again yields formulas analogous 
to (5) for some § € L(p,Z) and # € L(p,zZ’) lying on the same two lines. It 
again follows that for small 6, 

f(Z) — fp) > 0 > f(#) — F(P), 


just as P(u%) > 0 > P(v). 
Thus Af changes sign on G'j(6), and (iii) is proved. 


Note 3. Still unresolved are cases in which P(i) vanishes for some i # 0, 
without changing its sign; e.g., P(@) = (wu; + uz + us)? = 0 for @ = (1,1, -2). 
Then the answer depends on higher-order terms of the Taylor formula. In 
particular, if d' f(g, -) = d? f(z, -) =Oon E”, then Af = Ro = ad? f (p: 8), etc. 


Note 4. The largest or least value of f on a set A (sometimes called the 
absolute maximum or minimum) may occur at some noninterior (e.g., bound- 
ary) point p € A, and then fails to be among the local extrema (where, by 
definition, a globe Gz C A is presupposed). Thus to find absolute extrema, one 
must also explore the behaviour of f at noninterior points of A. 

By Theorem 1, local extrema can occur only at so-called critical points 7p, 
i.e., those at which all directional derivatives vanish (or fail to exist, in which 
case Dif (p) = 0 by convention). 

In practice, to find such points in E” (C”), one equates the partials D; f 
(k <n) to 0. Then one uses Theorems 2 and 3 or other considerations to 
determine whether an extremum really exists. 


Examples. 
(A) Find the largest value of 


f(x,y) =sinaz + siny — sin(a + y) 


on the set A C E? bounded by the lines x = 0, y = 0 and 2+ y = 2r. 
We have 


Di f(x,y) = cosx — cos(a + y) and Def (x,y) = cosy — cos(a + y). 


89. Local Extrema. Maxima and Minima 83 


Inside the triangle A, both partials vanish only at the point (27, 2") at 
which f = 3/3. On the boundary of A (i.e., on the lines x = 0, y = 0 
and ++y = 27), f =0. Thus even without using Theorem 2, it is evident 
that f attains its largest value, 


2a 27 3 

Bae Gee SA 8 
ue a3 ) 2 v3, 

at this unique critical point. 

Find the largest and the least value of 


f(z, y, 2) = a?x? + By? + 022? — (ax? + by* + cz”), 


on the condition that x2 +y?+22=landa>b>c>0. 


As 22 = 1-2? —y?, we can eliminate z from f(x, y,z) and replace f 
by F222 SS Es 


F(a,y) = (2 — 2 )2? + (0? = 2 )\y? +2 - [@—0)z? + (b— oy? +c). 


(Explain!) For F, we seek the extrema on the disc G = Go(1) Cc E”’, 
where x? + y” < 1 (so as not to violate the condition x? + y? + 27 = 1). 


Equating to 0 the two partials 
D,F(«,y) = 2x(a —c){(a +e) — 2[(a — c)x” + (b—c)y? + ¢}?} =0, 
D2 F(x,y) = 2y(b—¢) {(b +e) — 2[(a— e)x* + (6— hy’ + e?} =0 


and solving this system of equations, we find these critical points in- 
side G: 


(3) ¢ =+2-7, y=0( 
(Verify!) 7 
Now, for the boundary of G, i.e., the circle x? + y? = 1, repeat this 


process: substitute y? = 1 — x? in the formula for F(a, y), thus reducing 
it to 


h(a) = (a? — b?)a? +B? + [(a — b)a? +.0)?, A: EL E’, 
on the interval [-1,1] C E'. In (—1,1) the derivative 
h' (x) = 2(a — b)x(1 — 227) 


vanishes only when 
(4) c =0 (h=0), and 
(5) e=+2-3 (h= 1(a—8)?). 
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Finally, at the endpoints of [—1,1], we have 
(6) GS 1 (h = 0). 


Comparing the resulting function values in all six cases, we conclude 
that the least of them is 0, while the largest is +(a — c)?. These are the 
desired least and largest values of f, subject to the conditions stated. 
They are attained, respectively, at the points 


(0,0,+1), (0,+1,0), (£1,0,0), and (4272,0,+272). 


Again, the use of Theorems 2 and 3 was redundant.! However, we 
suggest as an exercise that the reader test the critical points of F’ by 
using Theorem 2. 


Caution. Theorems 1 to 3 apply to functions of independent variables only. 
In Example (B), x, y, z were made interdependent by the imposed equation 


ety +22 =1 


(which geometrically limits all to the surface of G5(1) in E*), so that one of 
them, z, could be eliminated. Only then can Theorems 1 to 3 be used. 


Problems on Maxima and Minima 


1. Verify Note 1. 
1’. Complete the missing details in the proof of Theorems 2 and 3. 
2. Verify Examples (A) and (B). Supplement Example (A) by applying 


Theorem 2. 
3. Test f for extrema in E? if f(x,y) is 
ey? 
i) —+=— (p>0,q> 0); 
@) E+E ( ) 
ey? 
ii) — —~ (p>0,q>0); 
a) FE 
(iii) y? + 2%; 
(iv) y2+2°. 


4. (i) Find the maximum volume of an interval A C E? (see Chapter 3, 
87) whose edge lengths x, y, z have a prescribed sum: r+y+z = a. 


(ii) Do the same in E* and in E”; show that A is a cube. 


' Indeed, by Theorem 2(ii) in Chapter 4, §8, absolute extrema must exist here, as all is 
limited to the compact sphere, x? + y? + z? =1. 
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(iii) Hence deduce that 


n 


1 
VEie2-En<—) te (an >), 


1 


3 


i.e., the geometric mean of n nonnegative numbers is < their arith- 
metic mean. 


5. Find the minimum value for the sum f(z, y,z,t) =x+y+2+t of four 
positive numbers on the condition that xyzt = c* (constant). 


[Answer: x =y=z=t=c; fmax = 4c.] 


6. Among all triangles inscribed in a circle of radius R, find the one of 
maximum area. 
[Hint: Connect the vertices with the center. Let x,y,z be the angles at the center. 
Show that the area of the triangle = +R? (sinaz+siny+sin z), with z = 27—(a#+y).] 


7. Among all intervals A C E? inscribed in the ellipsoid 


find the one of largest volume. 


; 2a 2 2c 
[Answer: the edge lengths are BR? '] 


8. Let P; = (a;.b;), i = 1,2,3, be 3 points in E? forming a triangle in 
which one angle (say, £P,) is > 27/3. 
Find a point P = (x,y) for which the sum of the distances, 


3 
PP, +PP,+ PP3= 5) /(e@—a)? + y— &)?, 
i=1 


is the least possible. 
[Outline: Let f(x,y) = 3_, Va — ai)? + (y— 8)?. 

Show that f has no partial derivatives at P,, P2, or P3 (and so P;, P2, and P3 are 
critical points at which an extremum may occur), while at other points P, partials 
do exist but never vanish simultaneously, so that there are no other critical points. 


Indeed, prove that D, f(P) = 0 = Dof(P) would imply that 


3 3 
S 5 cos 6; =0= So sin 6;, 
i=1 1 


where 0; is the angle between PP; and the x-axis; hence 
sin(04 — 02) = sin(62 = 03) = sin(63 = 01) (why?), 


and so 61 — 02 = 02 — 03 = 63 — 61 = 27/3, contrary to £P, > 27/3. (Why?) 
From geometric considerations, conclude that f has an absolute minimum at P\. 


(This shows that one cannot disregard points at which f has no partials.)| 
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9. 


10. 


11. 


12. 
13. 
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Continuing Problem 8, show that if none of <P,, £P2, and «P3 is > 
27/3, then f attains its least value at some P (inside the triangle) such 
that AEP P= £PoP Pee Pa PP; = 2073: 
[Hint: Verify that Dif =0 = Dof at P. 
Use the law of cosines to show that P,; P2 > PP 2+ 4 PP and P, P3 > PP3+ + PP. 
Adding, obtain P; P3 + P; P2 > PP, + PP2 + PP3, i.e, f(Pi) > f(P). Similarly, 
f(P2) > f(P) and f(P3) > f(P). 
Combining with Problem 8, obtain the result.] 


In a circle of radius R inscribe a polygon with n + 1 sides of maximum 
area. 


[Outline: Let 21,22,... ,%n+41 be the central angles subtended by the sides of the 


polygon. Then its area A is 
n+1 


1 
= R? sin 2p, 


with en41 = 2m — 0p, ep. (Why?) Thus all reduces to maximizing 


n n 
fle1y408,0n) = bs sinz, + sin(2n _ x. tk), 
k=1 k=1 
on the condition that 0 < x, and S7p_, _ < 2a. (Why?) 
These inequalities define a bounded set D C E” (called a simplex). Equating all 
partials of f to 0, show that the only critical point interior to D is Z = (x1,...,2n), 


with zp = ae k <n (implying that zn41 = an too). For that Z, we get 


f(Z) = (n+ 1)sin[27/(n + 1)]. 


This value must be compared with the “boundary” values of f, on the “faces” of the 
simplex D (see Note 4). 

Do this by induction. For n = 2, Problem 6 shows that f(#) is indeed the largest 
when all x, equal aie Now let Dn be the “face” of D, where x, = 0. On that face, 
treat f as a function of only n — 1 variables, 71,... ,%n-1. 

By the inductive hypothesis, the largest value of f on Dn is nsin(27/n). Similarly 
for the other “faces.” As nsin(27/n) < (n+ 1)sin2a/(n+1), the induction is 
complete. 


Thus, the area A is the largest when the polygon is regular, for which 


i! 


1 2 
A= —R?(n+1)sin é 
2 n 


Among all triangles of a prescribed perimeter 2p, find the one of maxi- 
mum area. 
[Hint: Maximize p(p — x)(p — y)(p — z) on the condition that «+ y+ z= 2p.] 


Among all triangles of area A, find the one of smallest perimeter. 


Find the shortest distance from a given point p € E” to a given plane 
u-#=c (Chapter 3, §§4-6). Answer: 
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(Hint: First do it in E%, writing (2, y, z) for #.] 
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I. Implicit differentiation was sketched in §7. Under suitable assumptions 
(Theorem 4 in §7), one can differentiate a given system of equations, 


(1) Ge Gisess as Uist ein HO, RSH Te ht, 
treating the x; as implicit functions of the y; without seeking an explicit solu- 


tion of the form 


y= Fg Wie eae . 
Lj 
OYi 


This yields a new system of equations from which the partials DjH; = 
can be found directly. 

We now supplement Theorem 4 in §7 (review it!) by showing that this new 
system is linear in the partials involved and that its determinant is 4 0. Thus 
in general, it is simpler to solve than (1). 

As in Part IV of §7, we set 

(x,y) = (Pix +25 Un, Y1y--- Yan) and g= (g1,- ate On), 
replacing the f of §7 by g. Then equations (1) simplify to 
(2) g(#, 9) = 9, 
where g: E™+™ — E” (or g: C"™™ > C”), 
Theorem 1 (implicit differentiation). Adopt all assumptions of Theorem 4 in 


87, replacing f by g and setting H =(Mj,... , Hn), 
D3 9x(P;@) =i jsntm, kan. 


Then for eachi=1,...,m, we have n linear equations, 
(3) >) aj. DiH;(Q) =—ansiz, b< 1, 
j=l 
with 


det (ajx) = 0; a; k< n), 
that uniquely determine the partials D;H;(q) for j =1,2,...,n. 


Proof. As usual, extend the map H: Q — P of Theorem 4 in 87 to H: E™ — 
E” (or C™ — C”) by setting H = 0 on —Q. 
Also, define 0: E™ > E™t™™ (C™ 5 C™™™) by 


(4) o(¥) = (AY), 9) = (AY), --- An), Y1,-- Ym), YE B™(C™). 


88 Chapter 6. Differentiation on #” and Other Normed Linear Spaces 


Then o is differentiable at ¢ € Q, as are its n +m components. (Why?) 
Since 7 = H(¥) is a solution of (2), equations (1) and (2) become identities 
when # is replaced by H(y). Also, o(@) = (H(q),q) = (p,q) since H(q) = Pp. 
Moreover, 

g(o(¥)) = 9 AY), ¥) = 0 for FE Q; 


ie., goo =0onQ. 

Now, by assumption, g € CD! at (p,q); so the chain rule (Theorem 2 in 
84) applies, with f, p, g, n, and m replaced by o, @, (f,@), m, and n+ ™m, 
respectively. 

As h = goo =0 on Q, an open set, the partials of h vanish on Q. So by 
Theorem 2 of §4, writing 0; for the jth component of o, 


ntm 


(5) 0= So Dj9P,Q)-Dioi(M, t<m. 
j=l 
By (4), oO; = Hi; if j <n, and o;(¥) = Vi if 7 =n-+1. Thus Djo; — DiAM5, 
j <n; but for 7 > n, we have Dio; = 1 if 7 =n +1, and Djo; = 0 otherwise. 
Hence by (5), 


0=S > Dj9(0,0) - DiHj (D+ Dnsig@,@, *=1,2,...,m. 
j=l 


As g = (g1,--- 59n), each of these vector equations splits into n scalar ones: 


(6) 0=S > Dig @,D) Di (D+ DnsignP.), i<m, k<n. 

j=1 
With Dj9x(p,¢) = ajx, this yields (3), where det(a;,) = det(D;9x(p,¢)) 4 9, 
by hypothesis (see Theorem 4 in §7). 


Thus all is proved. 


Note 1. By continuity (Note 1 in 86), we have det(Dj9x(Z,y)) 4 0 for all 
(Z, 7) in a sufficiently small neighborhood of (p, 7). Thus Theorem 1 holds also 


with (p,q) replaced by such (#, 7). In practice, one does not have to memorize 
(3), but one obtains it by implicitly differentiating equations (1). 


II. We shall now apply Theorem 1 to the theory of conditional extrema. 
Definition 1. 


We say that f: E"*™ — E' has a local conditional maximum (minimum) 
at p € E"t™, with constraints 


g = (91;--+ 59n) =9 
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(g: B"+™ — BE”) iff in some neighborhood G of p we have 
Af = f(Z)—f@) <9 (2 0, respectively) 
for all Z € G for which g(Z) = 0. 


In §9 (Example (B) and Problems), we found such conditional extrema by 


> 


using the constraint equations g = 0 to eliminate some variables and thus 
reduce all to finding the unconditional extrema of a function of fewer (inde- 
pendent) variables. 


Often, however, such elimination is cumbersome since it involves solving a 
system (1) of possibly nonlinear equations. It is here that implicit differentia- 
tion (based on Theorem 1) is useful. 


Lagrange invented a method (known as that of multipliers) for finding the 
critical points at which such extrema may exist; to wit, we have the following: 
Given f: E”*™ — E?}, set 


(7) F=f+)>0 cege, 


k=1 
where the constants c, are to be determined and gy, are as above. 


Then find the partials D;F (j < n+ m) and solve the system of 2n + m 
equations 


(8) D;F(¢@)=0, jant+m, and gi(e)=—0, kan, 
for the 2n + m “unknowns” 2; (j <n-+m) and cy (k <n), the c;, originating 
from (7). 

Any # satisfying (8), with the cz, so determined is a critical point (still to be 


tested). The method is based on Theorem 2 below, where we again write (9, @) 
for p and (Z, 7) for # (we call it “double notation” ). 


Theorem 2 (Lagrange multipliers). Suppose f: E"*™ — E! is differen- 
tiable at 


(D, 9) = (Diys«: »>PnsQ15+-- dm) 
and has a local extremum at (p,q) subject to the constraints 
g= (Fig an 19n) =, 
with g as in Theorem 1, g: E"t™ — E”. Then 
(9) So ceDj9n(8,9) =—-D;f8,0), j=1,2,...,n+m," 
k=1 


for certain multipliers cy, (determined by the first n equations in (9)). 


1 That is, D; F(p,q) = 0, with F as in (7). 
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Proof. These n equations admit a unique solution for the cz, as they are 
linear, and 


det(Djgi(B.Q) £0 (isk <n) 


by hypothesis. With the c, so determined, (9) holds for 7 < n. It remains to 
prove (9) forn<j<n+m. 
Now, since f has a conditional extremum at (j, 7) as stated, we have 


(10) FY) — FP,Q) <9 (or 2 0) 


for all (#,7) € P x Q with g(#,¥) = 0, provided we make the neighborhood 
P x Q small enough. 


> 


Define H and o as in the previous proof (see (4)); so 7 = H(y) is equivalent 
to g(@,¥) = 0 for (#,7)€E Px Q. 
Then, for all such (Z,#/), with # = H(i), we surely have g(Z, 7) = 0 and also 
f(E,9) = FAY), 9) = Fo(Y)). 
0) 


Set h = foo, h: E™ — E'. Then (10) reduces to 


h(¥) — h(q) <0 (or >0) forall YeQ. 


This means that h has an unconditional extremum at g, an interior point of 
Q. Thus, by Theorem 1 in 89, 


DMO=0, t=—lassm. 
Hence, applying the chain rule (Theorem 2 of §4) to h = foo, we get, much 
as in the previous proof, 


n+tm 


0= », Di f(@,DDioi(M) 
(11) = 
=S*D f(BODH) (D+ Dai fBO, t<m. 


(Verify!) 
Next, as g by hypothesis satisfies Theorem 1, we get equations (3) or equiv- 
alently (6). Multiplying (6) by c,, adding and combining with (11), we obtain 


k=1 


| [D; ee dawg: A;(q) 


+ Dn+if (B,G) + > CkDn+igr(P, 7) =0, i<m. 
k=l 
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(Verify!) But the square-bracketed expression is 0; for we chose the cz so as to 
satisfy (9) for 7 < n. Thus all simplifies to 


n 
S- ceDnsign(D,@) ==Drif (P,Q), 11 2, ,m. 
k=1 


Hence (9) holds for n < 7 <n-+™m, too, and all is proved. 


Remarks. Lagrange’s method has the advantage that all variables (the x, 
and y;) are treated equally, without singling out the dependent ones. Thus in 
applications, one uses only F’, i.e., f and g (not H). 

One can also write f= (45.524 2nd) for (2,9) = (Pisess pF Vises 5 mn) 
(the “double” notation was good for the proof only). 

On the other hand, one still must solve equations (8). 


Theorem 2 yields only a necessary condition (9) for extrema with constraints. 
There also are various sufficient conditions, but mostly one uses geometric and 
other considerations instead (as we did in §9). Therefore, we limit ourselves to 
one proposition (using “single” notation this time). 


Theorem 3 (sufficient conditions). Let 


F=f+)> cron, 


with f: E’+™ > EF! g: E™t™ — E”, and cg as in Theorem 2. 

Then f has a maximum (minimum) at Pp = (pi,..- ,Pn+m) (with constraints 
g = (91.--. 59n) = 9) whenever F does. (A fortiori, this is the case if F has 
an unconditional extremum at p.) 


Proof. Suppose F’ has a maximum at p, with constraints g = 0. Then 


0 > F(2) — F(B) = f(@) — f@) + D5 x [oe(@) — 9) 


> 


for those # near p (including 7 = p) for which g(Z) = 0. 
But for such #, gx (@) = gx (P) = 0, cx [gn(Z) — gx ()] = 0, and so 


0> F(#) — F(p) = f(#) — fF). 


Hence f has a maximum at p, with constraints as stated. 


Similarly, AF’ = Af in case F' has a conditional minimum at p. 


Example 1. 


Find the local extrema of 


f(z,y,z,t) =x+yt+2z+t 
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on the condition that 
g(x,y, z,t) = ryzt — a* = 0, 


with a > 0 and z,y,z,t > 0. (Note that inequalities do not count as 
“constraints” in the sense of Theorems 2 and 3.) Here one can simply 
eliminate t = a*/(xyz), but it is still easier to use Lagrange’s method. 

Set F(z,y,z,t) =cx+y+2z2+t+cryzt. (We drop a’ since it will 
anyway disappear in differentiation.) Equations (8) then read 


0=1+cyzt =1l+crzt =1+cryt=1l+cryz, xyzt—a*t=0. 


Solving for z,z,t and c, we get c= —a 3, re =y=z=t=a. 

Thus F(z, y,2z,t) =2+y+2+t—2yzt/a?, and the only critical point 
is p = (a,a,a,a). (Verify!) 

By Theorem 3, one can now explore the sign of F(z) — F(p), where 
= = (x,y,z,t). For £ near p, it agrees with the sign of d?F (jp, -). (See 
proof of Theorem 2 in §9.) We shall do it below, using yet another device, 
to be explained now. 


Elimination of dependent differentials. If all partials of F' vanish at p 
(e.g., if P satisfies (9)), then d'F(p, -) =0 on E™*™ (briefly dF = 0). 

Conversely, if d' f(p, -) = 0 on a globe Gz, for some function f on n inde- 
pendent variables, then 


Dy f(p) =0, k=1,2,...,n, 


since d' f(p, -) (a polynomial!) vanishes at infinitely many points if its coeffi- 
cients D;,f(p) vanish. (The latter fails, however, if the variables are interde- 
pendent.) 

Thus, instead of working with the partials, one can equate to 0 the differen- 
tial dF or df. Using the “variable” notation and the invariance of df (Note 4 
in §4), one then writes dx, dy,... for the “differentials” of dependent and inde- 
pendent variables alike, and tries to eliminate the differentials of the dependent 
variables. We now redo Example 1 using this method. 


Example 2. 


With f and g as in Example 1, we treat ¢t as the dependent variable, 
i.e., an implicit function of 2, y, z, 


t= a*/(xyz) = H(2,y,2), 
and differentiate the identity xyzt — a* = 0 to obtain 


0 = yztdz + eztdy+ cyt dz + xyz dt; 
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(12) 


sO 


dt = (= ! a) 


x y Zz 


Substituting this value of dt in df = dr+dy+dz-+dt = 0 (the equation 
for critical points), we eliminate dt and find: 


t t t 
(1--)ae+(1 ) ay + (1 )az=0. 
& y z 
As x,y,z are independent variables, this identity implies that the co- 
efficients of dx, dy, and dz must vanish, as pointed out above. Thus 


t t t 
x y z 


Hence x = y = z =t =a. (Why?) Thus again, the only critical point is 
p= (8,0; 0,0): 

Now, returning to Lagrange’s method, we use formula (5) in §5 to 
compute 


2 
dF = —~ (da dy + dex dz 4 dz dt + dx dt + dy dz + dydt). 


(Verify!) 

We shall show that this expression is sign-constant (if xyzt = a*), near 
the critical point p. Indeed, setting « = y = z = t = a in (12), we get 
dt = —(dx + dy + dz), and (13) turns into 


= = [ar dy + dx dz + dy dz — (dx + dy + dz)”| 
1 
= —[da* + dy’ + dz* + (da + dy + dz)"] =a°F. 


This expression is > 0 (for dx, dy, and dz are not all 0). Thus f has 
a local conditional minimum at jf = (a,a,a, a). 

Caution; here we cannot infer that f(j) is the least value of f under 
the imposed conditions: x,y,z > 0 and xryzt = a’. 

The simplification due to the Cauchy invariant rule (Note 4 in §4) 
makes the use of the “variable” notation attractive, though caution is 


mandatory. 


Note 2. When using Theorem 2, it suffices to ascertain that some n equa- 
tions from (9) admit a solution for the cz; for then, renumbering the equations, 
one can achieve that these become the first n equations, as was assumed. This 
means that the n x (n+ m) matrix (D;gx(p, ¢)) must be of rank n, i.e., con- 
tains ann x n-submatriz (obtained by deleting some columns), with a nonzero 
determinant. 
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In the Problems we often use r,s,t,... for Lagrange multipliers. 


Further Problems on Maxima and Minima 


1. Fill in all details in Examples 1 and 2 and the proofs of all theorems in 
this section. 


2. Redo Example (B) in §9 by Lagrange’s method. 


[Hint: Set F(a,y,2) = f(#,y,2) — r(e? + y? +22), g(a,y,2) =e? +y2@ + 22-1, 
Compare the values of f at all critical points.?| 


3. An ellipsoid 


is cut by a plane ux + vy + wz = 0. Find the semiaxes of the section- 
ellipse, i.e., the extrema of 


P=(f(zy2Paert+yt2 


under the constraints g = (91,92) = 0, where 


g(x,y, z) =ux+vy+wz and go(z,y,z)= z+at+ 1. 


Assume that a > 6 > c > 0 and that not all u,v,w = 0. 
[Outline: By Note 2, explore the rank of the matrix 
(14) z/a% y/b? z/c? 

U VU z 


(Why this particular matrix?) 


Seeking a contradiction, suppose all its 2 x 2 determinants vanish at all points of 
the section-ellipse. Then the upper and lower entries in (14) are proportional (why?); 
so x? /a? + y?/b? + 22/c? =0 (a contradiction!). 


Next, set 
2 2 2 
F(2,y,2z) =a? +y? +274 r(= S s ) + 2s(ux + vy + wz). 
a2 b c2 
Equate dF to 0: 
TL ry TZ 
(15) e+ —+su=0, yt——+sv=0, z+ —+sw=0. 
a b2 Cc 


Multiplying by z,y, z, respectively, adding, and combining with g = 0, obtain r = 
—p; So, by (15), for a, b,c # P; 


—sua? —svb? —swe 
Li y = 
a2 — p2’ 


Find s,z,y,z, then compare the p-values at critical points.] 


? This suffices here, since the equation g = 0 defines a compact set S; see §9. 
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4. Find the least and the largest values of the quadratic form 
n 
f(z) = DS AikLite (ik = ani) 
ik=1 


on the condition that g(Z) = |z|? -1=0 (f,g: E” — E'). 
[Outline: Let F(Z) = f(Z) — t(a7 +22 +...+22). Equating dF to 0, obtain 


(ai1 —t)a1 +a12%2+...+a1n tn = 0, 
(16) a21 24 (a22 t) wat+...+ aan tn =O, 


Qn1 ®1 +an2%2+...4+ (Qnn —t) rn = 0. 


Using Theorem 1(iv) in §6, derive the so-called characteristic equation of f, 


aii —t aji2 bac ain 
a G99 6 ee a 
(17) 21 22 2n _ 0, 
An1 a2Qn, wee) Ann —t 


of degree n in t. If t is one of its n roots (known to be real?), then equations (16) 
admit a nonzero solution for = (#1,... ,2%n); by replacing Z by #/|z| if necessary, 
& satisfies also the constraint equation g(#) = |%|? — 1 = 0. (Explain!) Thus each 
root t of (17) yields a critical point Z = (x1,... ,@n). 

Now, to find f(z), multiply the kth equation in (16) by zz, k = 1,...,n, and 
add to get 


Hence f (Zt) = t. 

Thus the values of f at the critical points Z; are simply the roots of (17). The 
largest (smallest) root is also the largest (least) value of f on S = {% € E” | |z| = 1}. 
(Explain!)] 


5. Use the method of Problem 4 to find the semiaxes of 


(i) the quadric curve in E?, centered at 0, given by yi pj CET. = 
1; and 


(ii) the quadric surface ae AikLiLE = 1 in E%, centered at 0. 


Assume a;p = Gj. 
|? on the condition that 


[Hint: Explore the extrema of f(#) = |Z 


g(Z) = yy A;pLiL_ —1=0.] 
i,k 


6. Using Lagrange’s method, redo Problems 4, 5, 6, 7, 11, 12, and 13 of §9. 
7. In E?, find the shortest distance from 0 to the parabola y? = 2(x +a). 


3 See S. Perlis, Theory of Matrices, Reading, Mass., 1952, Theorem 9-25. 
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8. In EB, find the shortest distance from 0 to the intersection line of two 


planes given by the formulas u-% = a and v-% = 6 with w and v different 
from 0. (Rewrite all in coordinate form!) 


. In E”, find the largest value of |@- | if |Z| = 1. Use Lagrange’s method. 
*10. 


(Hadamard’s theorem.) If A = det(xjx) (i,k <n), then 


|Al < [[@il, 
41. 


where:£; = (Wij @ia,24> 5 Lin) 
(Hints: Set a; = |Z;|. Treat A as a function of n? variables. Using Lagrange’s method, 


prove that, under the n constraints |Z;|? —a? = 0, A cannot have an extremum unless 
A? = det(y;x), with y;, = 0 (if¢ Ak) and yj; = a?.] 


Chapter 7 
Volume and Measure 


Our intuitive idea of “volume” is rather vague. We just tend to assume that 
“bodies” in space (i.e., in EH?) somehow have numerically expressed “volumes,” 
but it remains unclear which sets in E* are “bodies” and how volume is defined. 

We also intuitively assume that volumes behave “additively.” That is, if a 
body is split into disjoint parts, then the volume of the whole equals the sum of 
the volumes of the parts. Similarly for “areas” in E?. In elementary calculus, 
that is often just taken for granted. 

The famous mathematician Henri Lebesgue (1875-1941) extended the idea 
of “volume” to a large, strictly defined family of sets in E”, called Lebesque- 
measurable sets, thus giving rise to what is called measure theory. Its basic idea 
remains that of additivity, precisely formulated and proved. Modern theory has 
still more generalized these ideas. In this text, we have so far defined “volumes” 
for intervals in E” only. Thus it is natural to take intervals as our starting point. 
This will also lead to the important idea of a semiring of sets and its extension: 
a ring of sets. 


§1. More on Intervals in E”. Semirings of Sets 


I. As a prologue, we turn to intervals in E” (Chapter 3, §7). 
Theorem 1. /f A and B are intervals in E”, then 
(i) AN B is an interval (0 counts as an interval); 
(ii) A—B is the union of finitely many disjoint intervals (but need not be an 
interval itself). 


Proof. The easy proof for E! is left to the reader. 
An interval in E? is the cross-product of two line intervals. 
Let 
Aza Xx *Y and Bax’ sy, 


where X, Y, X’, and Y’ are intervals in E!. Then (see Figure 29) 
ANB=(XxY)N(X'x VY) =(XNX') x (YNY’) 
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and 
A-B=([(X —X’')x YJU[(XN X’) x (Y —Y’)]; 
see Problem 8 in Chapter 1, 881-3. x! B 
As the theorem holds in E!, f 


XX andYny’ 


ANB Yoy’ | 


| 
i= 


are intervals in E!, while 


XY’ and ¥Y —Y' 


X—-X'' Xn x! \ 
A < xX 


are finite unions of disjoint line intervals. 
(In Figure 29 they are just intervals, but 
in general they are not.) 


FIGURE 29 


It easily follows that AM B is an interval in E?, while A — B splits into 
finitely many such intervals. (Verify!) Thus the theorem holds in E?. 

Finally, for E”, use induction. An interval in E” is the cross-product of an 
interval in E"~! by a line interval. Thus if the theorem holds in E”~!, the 
same argument shows that it holds in E”, too. (Verify!) 


This completes the inductive proof. 


Actually, Theorem 1 applies to many other families of sets (not necessarily 
intervals or sets in £”). We now give such families a name. 
Definition 1. 
A family C of arbitrary sets is called a semiring iff 
(i) 0 €C (@ is a member), and 


(ii) for any sets A and B from C, we have ANB € C, while A— B is the 
union of finitely many disjoint sets from C. 


Briefly: C is a semiring iff it satisfies Theorem 1. 

Note that here C is not just a set, but a whole family of sets. Recall (Chap- 
ter 1, §§1-3) that a set family (family of sets) is a set MM whose members are 
other sets. If A is a member of M, we call A an M-set and write A € M (not 
ACM). 


Sometimes we use index notation: 
M = {X; |i € I}, 


briefly 
M = {x3}, 


where the X; are M-sets distinguished from each other by the subscripts 2 
varying over some index set J. 
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A set family M = {.X;} and its union 
Ux 
are said to be disjoint iff 
X;, X; = whenever i F j. 
Notation: 
U X;, (disjoint). 


In our case, A € C means that A is a C-set (a member of the semiring C). 
The formula 
(VA,BEC) ANBEC 


means that the intersection of two C-sets in a C-set itself. 
Henceforth, we will often speak of semirings C in general. In particular, this 
will apply to the case C = {intervals}. Always keep this case in mind! 


Note 1. By Theorem 1, the intervals in E” form a semiring. So also do 
the half-open and the half-closed intervals separately (same proof!), but not 
the open (or closed) ones. (Why?) 


Caution. The union and difference of two C-sets need not be a C-set. To 
remedy this, we now enlarge C. 


Definition 2. 
We say that a set A (from C or not) is C-simple and write 
AéeC, 


iff A is a finite union of disjoint C-sets (such as A — B in Theorem 1). 


Thus C{ is the family of all C-simple sets. 


Every C-set is also a C{-set, ie., a C- 
simple one. (Why?) Briefly: 


cece. 


If C is the set of all intervals, a C-simple 
set may look as in Figure 30. FIGURE 30 


Theorem 2. [fC is a semiring, and if A and B are C-simple, so also are 
ANB, A—B, and AUB. 
In symbols, 


(VA,BeEC!) ANBeC!, A-BEC!, and AUBEC!. 
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We give a proof outline and suggest the proof as an exercise. Before at- 
tempting it, the reader should thoroughly review the laws and problems of 
Chapter 1, 881-3. 


(1) To prove AN Be C%, let 
A= |J Aj (disjoint) and B = |_) Bg (disjoint), 
4=1 k=1 
with A;,B, €C. Verify that 


n m 


ANB= |) U(Ain Br) (disjoint), 


k=1i=1 
and so AN Be Ci. 
(2) Next prove that A- BeClif AECl and BEC. 


Indeed, if 
A= 2) A; (disjoint), 
i=1 
then 
A-B=|(J4Ai- B=(J(Ai— B) (disjoint). 
i=l i=1 


Verify and use Definition 2. 
(3) Prove that 
(VA,BeEC!) A-BECI,; 


we suggest the following argument. 
Let 


B= U By, Brec. 
k=1 


Then 


n 


pA eens 


k=1 k=1 
by duality laws. But A — By, is C-simple by step (2). Hence so is 
A-B={)\(A- By) 
k=1 


by step (1) plus induction. 
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(4) To prove AU B € C%, verify that 
AUB=AU(B-A), 
where B— AEC, by (38). 
Note 2. By induction, Theorem 2 extends to any finite number of C/-sets. 


It is a kind of “closure law.” 

We thus briefly say that C{ is closed under finite unions, intersections, and 
set differences. Any (nonempty) set family with these properties is called a set 
ring (see also §3). 

Thus Theorem 2 states that if C is a semiring, then Cl is a ring. 

Caution. An infinite union of C-simple sets need not be C-simple. Yet we 
may consider such unions, as we do next. 

In Corollary 1 below, C{ may be replaced by any set ring M. 

Corollary 1. If {A,} is a finite or infinite sequence of sets from a semiring 


C (or from a ring M such as C‘), then there is a disjoint sequence of C-simple 
sets (or M-sets) By, C An such that 


(Ag =| J Bas 
Proof. Let B, = A, and for n= 1,2,..., 


Baar = Aga = U Ay, Ay EC: 
k=1 
By Theorem 2, the B, are C-simple (as are A,4, and = A;,). Show that 
they are disjoint (assume the opposite and find a contradiction) and verify that 
UAn =UBn: If « € UAn, take the least n for which x € A,. Then n > 1 
and 


n-1 
x€ Ay, - J An = Bn, 
k=1 


orn=landaze A; = By. 


Note 3. In Corollary 1, B, € Cf, ie., By = Uj, Cni for some disjoint sets 


Cri € C. Thus 
Un UU cn 


nm. 11 
is also a countable disjoint union of C-sets. 
II. Recall that the volume of intervals is additive (Problem 9 in Chapter 3, 


87). That is, if A € C is split into finitely many disjoint subintervals, then vA 
(the volume of A) equals the sum of the volumes of the parts. 
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We shall need the following lemma. 
Lemma 1. Let X1, X2,...,Xm €C (intervals in E”). If the X; are mutually 
aos then 
wo U X; CY €C implies Se <vY; and 


al 


i=1 
m Pp 
(with Y; € C) implies SX; < So voY¥e. 


Pp 
REA i=l k=1 


Proof. (i) By Theorem 2, the set 


ics 


is C-simple; so 


for some disjoint intervals C;. Hence 
Y =(JXi ULC; (all disjoint). 


Thus by additivity, 


vY = Se +20; = Sik 
i=l j=l = 


as claimed. 
(ii) By set theory (Problem 9 in Chapter 1, §§1-3) 

Pp 

= U Y;, 
k=1 
implies 
Pp Pp 
xX =2in | y= Janay). 
k=1 


k=1 
If it happens that the Y; are mutually disjoint also, so certainly are the 


smaller intervals X; Y;; so by additivity, 
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Hence 
m Pp Pp m 
Soex%, =>) oN) = apres n %)] 
i=1 t=1 k=1 k=1bi=1 
But by (i), 
Su Xi a) Yx) < vY;z (why?); 
i=1 
so 


m Pp 
se VX < S° UYk, 
41) k=1 


as required. 
If, however, the Y; are not disjoint, Corollary 1 yields 


Lv. = (J Be (disjoint), 


with 
Mk 
Yr > Be = J Crs (disjoint), Cy €C. 
j=l 
By (i), 
Mk 
res, <vuY, 
j=l 
As 
m p Pp Mk 
UxsoUN=U Be =U U Cag (disjoint), 
i=l k=1 k=1 k=1j=1 


all reduces to the previous disjoint case. 


Corollary 2. Let A €C{ (C = intervals in E”). If 
m Pp 
A= U X; (disjoint) = U Y; (disjoint) 
i=1 k=1 
with X;,Y, €C, then 


s: UX; = 3 vY,. 
i=1 


k=1 


(Use part (ii) of the lemma twice.) 
Thus we can (and do) unambiguously define vA to be either of these sums. 
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Problems on Intervals and Semirings 
1. Complete the proof of Theorem 1 and Note 1. 
1’. Prove Theorem 2 in detail. 
2. Fill in the details in the proof of Corollary 1. 
2’. Prove Corollary 2. 


3. Show that, in the definition of a semiring, the condition @ € C is equiv- 
alent to C 4). 
[Hint: Consider § = A— A=", A; (A, Ai € C) to get 0 = A; EC.) 
4. Given a set S, show that the following are semirings or rings. 
(a) C = {all subsets of S }; 


(b) C = {all finite subsets of S }; 
(c) C= {0}; 
(d) C = {@ and all singletons in S'}. 
Disprove it for C = {@ and all two-point sets in S}, S = {1,2,3,...}. 
In (a)-(c), show that Cl = C. Disprove it for (d). 
5. Show that the cubes in E” (n > 1) do not form a semiring. 


6. Using Corollary 2 and the definition thereafter, show that volume is 
additive for C-simple sets. That is, 


m m 
if A = |_) Aj (disjoint) then vA=S vA; (A, Aj € C6). 
t=1 t=1 
7. Prove the lemma for C-simple sets. 
[Hint: Use Problem 6 and argue as before.] 


8. Prove that if C is a semiring, then C/ (C-simple sets) = C,, the family of 
all finite unions of C-sets (disjoint or not). 
[Hint: Use Theorem 2.] 
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We now want to further extend the definition of volume by considering count- 
able unions of intervals, called C,-sets (C being the semiring of all intervals 
in E”). 

We also ask, if A is split into countably many such sets, does additivity still 
hold? This is called countable additivity or o-additivity (the o is used whenever 
countable unions are involved). 

We need two lemmas in addition to that of §1. 
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Lemma 1. /f B is a nonempty interval in E”, then given « > 0, there is an 
open interval C' and a closed one A such that 

ACBCC 
and 

vu —e<vuB<vA+te. 
Proof. Let the endpoints of B be 
= (Gina. Oy, and: O =A bias. 4 On): 

For each natural number 7, consider the open interval C;, with endpoints 


1 1 1 1 1 1 
(a1 - =, 2-2, ...,an- =) and (b+ =, be +=)... bn +=). 
a a a a a a 


Then B C C; and 
re= FIs} —(o- 2] 
k=1 


Making i — oo, we get 


(b, — ax + =). 


1 


n 


k 


lim vC; = [| (bs — ax) = vB. 
t— CO k=l 
(Why?) Hence by the sequential limit definition, given ¢ > 0, there is a natural 
i such that 
vC; —vB <e, 


or 
uC; —e < vB. 


As C; is open and D B, it is the desired interval C. 
Similarly, one finds the closed interval A C B. (Verify!) 


Lemma 2. Any open set G C E” is a countable union of open cubes Ay and 
also a disjoint countable union of half-open intervals. 


(See also Problem 2 below.) 
Proof. If G =, take all A, = 0. 
If G4, every point p € G has a cubic neighborhood 
Cp c G, 


centered at p (Problem 3 in Chapter 3, §12). By slightly shrinking this C),, 
one can make its endpoints rational, with p still in it (but not necessarily its 
center), and make C, open, half-open, or closed, as desired. (Explain!) 
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Choose such a cube C, for every p € G; so 
GoUG. 
peG 
But by construction, G contains all Cp, so that 
G=\|)¢, 
peG 


Moreover, because the coordinates of the endpoints of all C, are rational, 
the set of ordered pairs of endpoints of the C, is countable, and thus, while the 
set of all p € G is uncountable, the set of distinct C, is countable. Thus one 
can put the family of all C, in a sequence and rename it {.A;}: 


coli, 
k=1 


If, further, the A, are half-open, we can use Corollary 1 and Note 3, both 
from §1, to make the union disjoint (half-open intervals form a semiring!). 


Now let C, be the family of all possible countable unions of intervals in E”, 
such as G in Lemma 2 (we use C, for all finite unions). Thus A € C, means 


that A is a C,-set, i-e., 
co 
A=Ai 
i=1 


for some sequence of intervals {A;}. Such are all open sets in E”, but there 
also are many other C,-sets. 


We can always make the sequence {A;} infinite (add null sets or repeat a 
term!). 


By Corollary 1 and Note 3 of §1, we can decompose any C,-set A into count- 
ably many disjoint intervals. This can be done in many ways. However, we 
have the following result. 


Theorem 1. /f 


A= U A; (disjoint) = U By, (disjoint) 
i=1 k=1 


for some intervals A;, By in E”, then 


Sod = - vB, 
w=1 k=1 


| Recall that a positive series always has a (possibly infinite) sum. 


§2. C,-Sets. Countable Additivity. Permutable Series 107 


Thus we can (and do) unambiguously define either of these sums to be the 
volume vA of the C,-set A. 


Proof. We shall use the Heine—Borel theorem (Problem 10 in Chapter 4, 86; 
review it!). 
Seeking a contradiction, let (say) 


S- vA; > S° vB, 
t=1 kt 
so, in particular, 
S vB < +00. 
k=1 
As 
S vA; = lim So vAi, 
i=l ey | 
there is an integer m for which 
S> vA; > oS vB, 
4=1 k=1 
We fix that m and set 
m [o-@) 
2Qe= So vA; - SS" uBy > 0. 
i=l k=1 


Dropping “empties” (if any), we assume A; 4 and B, 4 0. 
Then Lemma 1 yields open intervals Y; > By, with 
€ 
UB, > VY, — BR? ial ree 
and closed ones X; C Aj, with 


€ 
vX; + — > vA;; 
m 


so 
Qe = So vA; _ SS uBy 4 ww. + =) - Y(e%; x) 
i=1 k=1 i=1 a p= : 
= SX; — Sy; + 2e 
i=1 k=1 
Thus 


(1) ere > en 
i=1 k=1 
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(Explain in detail!) 
Now, as 


X,;CA,;CA= Us Uv 


each of the closed intervals X; is covered by the open sets Yx. 
By the Heine—Borel theorem, LJ," , X; is already covered by a finite number 
of the Y;,, say, 
Pp 


The X; are disjoint, for even the i sets A; are. Thus by Lemma 1(ii) in §1, 


mm Pp CO 
So 0X; = So oY, < ys 
=i k=l k=1 


contrary to (1). This contradiction completes the proof. 


m 


I 


a 


Corollary 1. [f 
A= U By, (disjoint) 
k=1 


for some intervals By, then 
vA = > VUBp. 
k=1 


Indeed, this is simply the definition of vA contained in Theorem 1. 


Note 1. In particular, Corollary 1 holds if A is an interval itself. We express 
this by saying that the volume of intervals is a-additive or countably additive. 
This also shows that our previous definition of volume (for intervals) agrees 
with the definition contained in Theorem 1 (for C,-sets). 


Note 2. As all open sets are C,-sets (Lemma 2), volume is now defined for 
any open set A C E” (in particular, for A = E”). 


Corollary 2. If A;, By are intervals in E”, with 


i=1 k=) 


then provided the A; are mutually disjoint, 


[o.e) 


(2) \ (vA; < y By. 


i=l k=1 
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The proof is as in Theorem 1 (but the By, need not be disjoint here). 
Corollary 3 (“o-subadditivity”? of the volume). Jf 
Are U Bx, 

k=1 

where AEC, and the By are intervals in E”, then 
vA < s uBx. 

k=1 

Proof. Set 
A=(JAi (disjoint), Ai €C, 


i=1 


and use Corollary 2. 


Corollary 4 (“monotonicity”’). If A,B €C,, with 
ACB, 


then 
vA < vB. 


(“Larger sets have larger volumes.” ) 
This is simply Corollary 3, with U, By = B. 
Corollary 5. The volume of all of E” is oo (we write co for +00). 


Proof. We have A C E” for any interval A. 
Thus, by Corollary 4, vA < vE”. 
As vA can be chosen arbitrarily large, vE” must be infinite. 


Corollary 6. For any countable set A C BE”, vA =0. In particular, vd = 0. 


Proof. First let A = {a} be a singleton. Then we may treat A as a degenerate 
interval [a,a]. As all its edge lengths are 0, we have vA = 0. 
Next, if A = {@,G@,...} is a countable set, then 


A= |J{a}: 
k 


SO 


vA = a v{a.)=0 
k 
by Corollary 1. 


? This notion is treated in more detail in §5. 
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Finally, ( is the degenerate open interval (G,@); so vu) = 0. 


Note 3. Actually, all these propositions hold also if all sets involved are 
C,-sets, not just intervals (split each C,-set into disjoint intervals!). 


Permutable Series. Since o-additivity involves countable sums, it appears 
useful to generalize the notion of a series. 


We say that a series of constants, 


y an, 


is permutable iff it has a definite (possibly infinite) sum obeying the general 
commutative law: 


Given any one-one map 
onto 
u: N<—>N 


(N = the naturals), we have 
Dn = Dns 


where Un = u(n). 

(Such are all positive and all absolutely convergent series in a complete space 
E; see Chapter 4, §13.) If the series is permutable, the sum does not depend 
on the choice of the map u. 


Thus, given any u: N 2° J (where J is a countable index set) and a set 
{a,|te J} CE 


(where E is E* or a normed space), we can define 


ee) 
di =D) dun 
owe 


ied 
if >>, Gu, ts permutable. 


In particular, if 
J=NxWN 


(a countable set, by Theorem 1 in Chapter 1, §9), we call 
ra 
ie J 


a double series, denoted by symbols like 


S- akn (k,n e€ N). 
n,k 
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Note that 


do al 


ied 


is always defined (being a positive series). 


If 
a |ai| < 00, 


iEet 


we say that }7,-, ai converges absolutely. 


For a positive series, we obtain the following result. 
Theorem 2. 
(i) All positive series in E* are permutable. 
(ii) For positive double series in E*, we have 


(3) aes paths on) =>-( 3 ont) 


n,k=1 n=1 k=1 ‘n 


Proof. (i) Let 


CO m 
s= So an and Sm = ea (a, > 0). 
n=1 n=1 


Then clearly 
Sm41 = 8m +Am41 2 Sm} 


i.e., {Sm}T, and so 


m—co 


s= lim 5s, =supSm 
m 


by Theorem 3 in Chapter 3, §15. 
Hence s certainly does not exceed the lub of all possible sums of the form 


dou 
i€l 
where I is a finite subset of N (the partial sums s,,, are among them). Thus 
(4) $ < sup S> Qi, 
i€I 
over all finite sets IC N. 


On the other hand, every such }),-; a; is exceeded by, or equals, some $y. 
Hence in (4), the reverse inequality holds, too, and so 


s= sup > aj. 


tel 
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But sup)),<, ai clearly does not depend on any arrangement of the aj. 
Therefore, the series 5) a,, is permutable, and assertion (i) is proved. 

Assertion (ii) follows similarly by considering sums of the form }),-; ai, 
where I is a finite subset of N x N, and showing that the lub of such sums 
equals each of the three expressions in (3). We leave it to the reader. 


A similar formula holds for absolutely convergent series (see Problems). 


Problems on C,-Sets, o-Additivity, and Permutable Series 


1. Fill in the missing details in the proofs of this section. 
1’. Prove Note 3. 


2. Show that every open set A 4 ( in E” is a countable union of disjoint 
half-open cubes. 


[Outline: For each natural m, show that E” is split into such cubes of edge length 
2—™ by the hyperplanes 


t,=— i=0,+1,42,...; k=1,2,...,n, 
am 


and that the family C;, of such cubes is countable. 


For m > 1, let Cmi,Cm2,... be the sequence of those cubes from Cm (if any) 
that lie in A but not in any cube C,; with s <_m. 


As A is open, « € A iff x € some Cm;.] 


3. Prove that any open set A C E! is a countable union of disjoint (possibly 
infinite) open intervals. 
[Hint: By Lemma 2, A = U,, (an, bn). If, say, (a1, 61) overlaps with some (am, bm), 
replace both by their union. Continue inductively.] 


4. Prove that C, is closed under finite intersections and countable unions. 
(i) Find A,B €C, such that A— B ¢ Cg. 
(ii) Show that C, is not a semiring. 
(Hint: Try A = E!, B = R (the rationals).] 


Note. In the following problems, J is countably infinite, a; © E (EF complete). 
6. Prove that 
S° |a;| < 00 
i€ J 


iff for every ¢ > 0, there is a finite set 


Bed iF Ap) 
such that 
S> la;| <e 
iel 


for every finite Cc J — F. 
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8’. 


onto 


[Outline: By Theorem 2, fix wu: N —> J with 
de lal = Do lawn: 
ied n=1 


By Cauchy’s criterion, 


co 
x l@un| < co 
n=1 


(Ve >0) (Aq) (Vn >m>q) YO lal <e. 
k=m 


Let F = {u1,..., ug}. If I is as above, 


(dn>m>q) {um,.-.,Un} 27; 


so 


n 
Do lail< SO lau! < e 
k=m 


wel 


Prove that if 


ye la;| < 00, 


ied 
then for every ¢ > 0, there is a finite F Cc J (F £0) such that 
Ta-Tas 
ie J ick 


for each finite K > F (Kk C J). 
[Hint: Proceed as in Problem 6, with J = K — F and q so large that 


<€é 


1 1 
dew Dea < 5° and Da < 5°! 
iET iCk ick 

Show that if 
[o-e) 
j= U I, (disjoint), 
n=1 
then 
[o-e) 
S> ea) = S> bn, where bp, = Se |a;|. 
iC J n=1 i€In 


(Use Problem 8’ below.) 
Show that 


lal = sup ) | |a,| 


ied ieF 
over all finite sets F C J (F £0). 
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[Hint: Argue as in Theorem 2.] 
Show that if 0 A J C J, then 
dla] < Dla 
tel tet 
[Hint: Use Problem 8’ and Corollary 2 of Chapter 2, §§8-9.] 


Continuing Problem 8, prove that if 
d lal = D bn < 00, 
tet n=1 

then 


So ai = oo with c, = Qj. 
n=1 


iEeS tElIy 


[Outline: By Problem 9, 


(Vn) a |aj| < 00; 
i€In 
so 
aoe 
i€In 
and 


en 
n=1 
converge absolutely. 
Fix ¢ and F as in Problem 7. Choose the largest q € N with 
FoIg #9 
(why does it exist?), and fix any n > q. By Problem 7, (Vk < n) 


(Vk <n) (A finite Fy | JD Fy D FOI) 


1 
(Vv finite H;, | I, D Hy D Fr) < ae 


n 
dH De 
i€H, k=1 


(Explain!) Let 


k=1 
so 
Ck — Soa <e 
k=1 ted 
and kK D F. By Problem 7, 
y ai yea <eé 
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Deduce a 
> Ck — > ai] < 2e. 


k=1 1ES 


Let n — oo; then e — 01] 


11. (Double series.) Prove that if one of the expressions 


5 lawl > (Den!) S>(S- lana!) 


n,k=1 n=1 k=1 ‘n=1 
is finite, so are the other two, and 
Yon =O (Lan) =H (Lan), 
n,k n k k n 


with all series involved absolutely convergent. 
[Hint: Use Problems 8 and 10, with J= N x N, 


In = {(n,k) € J| k=1,2,...} for each n; 


so 
CoO Co 
bn = y lang] and cn = > Ank- 
k=1 k=1 


Thus obtain 


Se = ey ank- 
n,k nek 


Similarly, 


S- ank = x > On,k-] 
n,k kon 


§3. More on Set Families! 


Lebesgue extended his theory far beyond C,-sets. For a deeper insight, we shall 
consider set families in more detail, starting with set rings. First, we rephrase 
and supplement our former definition of that notion, given in §1. 


Definition 1. 
A family M of subsets of a set S is a ring or set ring (in S) iff 
(i) 0€ M, ie., the empty set is a member; and 


(ii) M is closed under finite unions and differences: 


WX, YeM) XUYEM and X-YeEM. 


1 For a limited approach (see the preface), this topic may be omitted. 
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(For intersections, see Theorem 1 below.) 
If M is also closed under countable unions, we call it a o-ring (in S). 

Then 

oo 

U X; EM 

i=1 
whenever 

X; €M fori =1,2,.... 


If S itself is a member of a ring (o-ring) M, we call M a set field 
(o-field), or a set algebra (o-algebra), in S. 
Note that S is only a member of M, S € M, not to be confused with 


M itself. 
The family of all subsets of S (the so-called power set of S) is denoted by 
2° or P(S). 
Examples. 
(a) In any set 9, 2° is a o-field. (Why?) 
(b) The family {0}, consisting of @ alone, is a o-ring; {0,5} is a o-field in S. 
(Why) 
(c) The family of all finite (countable) subsets of S is a ring (o-ring) in S. 
(d) For any semiring C, C! is a ring (Theorem 2 in §1). Not so for C, 
(Problem 5 in §2). 
Theorem 1. Any set ring is closed under finite intersections. 
A o-ring is closed under countable intersections. 


Proof. Let M be a o-ring (the proof for rings is similar). 
Given a sequence {A,,} C M, we must show that (],, An € M. 


Let 
Us| An: 


By Definition 1, 
UeMandU—A, €M, 


as M is closed under these operations. Hence 


(J(u -— An) EM 


rm 


and 
U-|J - An) <M, 
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or, by duality, 
(\le-U -A) eM, 


Le., 


(An € M. 


Corollary 1. Any set ring (field, o-ring, o-field) is also a semiring. 
Indeed, by Theorem 1 and Definition 1, if M is a ring, then 0 © M and 


(VA,BEM) ANBeEMandA-BEM. 


Here we may treat A— B as (A— B)U@, a union of two disjoint M-sets. Thus 
M has all properties of a semiring. 

Similarly for o-rings, fields, etc. 

In §1 we saw that any semiring C can be enlarged to become a ring, C4. More 
generally, we obtain the following result. 


Theorem 2. For any set family M in a space S (M C 2°), there is a unique 
“smallest” set ring R such that 


Ram 
(“smallest” in the sense that 

y Ea i 
for any other ring R' with R’ DM). 


The R of Theorem 2 is called the ring generated by M. Similarly for o-rings, 
fields, and o-fields in S. 


Proof. We give the proof for o-fields; it is similar in the other cases. 
There surely are o-fields in S that contain M; e.g., take 2°. Let {R;} be 
the family of all possible o-fields in S' such that R; > M. Let 


R=(\Re 
We shall show that this R is the required “smallest” o-field containing M. 
Indeed, by assumption, 
MC()Ri=R. 
We now verify the o-field properties for R. 


(1) We have that 
(Vi) Ne R; and S € R; 
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(for R; is a o-field, by assumption). Hence 
OE()Ri=R. 
Similarly, S € R. Thus 
0S ER. 


(2) Suppose 
X,YeR=()Ri. 


Then X,Y are in every R;, and so is X — Y. Hence X — Y is in 
(|Ri=R. 


Thus F is closed under differences. 
(3) Take any sequence 


{A,} CR=()Rz. 
Then all A, are in each R;. U,, An is in each R,; so 


[J An ER. 


Thus R is closed under countable unions. 
We see that R is indeed a o-field in S, with M C R. As FR is the intersection 
of all R; (i.e., all o-fields > M), we have 


(Vi) RCR: 


so R is the smallest of such o-fields. 
It is unique; for if R’ is another such o-field, then 


RCR'CR 
(as both R and R’ are “smallest” ); so 
Rak. 


Note 1. This proof also shows that the intersection of any family {R;} of 
o-fields is a o-field. Similarly for o-rings, fields, and rings. 


Corollary 2. The ring R generated by a semiring C coincides with 
C, = {all finite unions of C-sets} 


and with 
Cl = {disjoint finite unions of C-sets}. 
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Proof. By Theorem 2 in §1, C{ is a ring D C; and 
CCCsER 
(for R is closed under finite unions, being a ring D C). 
Moreover, as FR is the smallest ring > C, we have 
RoC CCC RK. 


Hence 
R= C. = Cz, 


as claimed. 


It is much harder to characterize the o-ring generated by a semiring. The 
following characterization proves useful in theory and as an exercise.” 


Theorem 3. Theo-ring R generated by a semiring C coincides with the small- 
est set family D such that 


(i) Doc; 
(ii) D is closed under countable disjoint unions; 
(iii) J-—X €D whenever X ED, JEC, and X C J. 
Proof. We give a proof outline, leaving the details to the reader. 


(1) The existence of a smallest such D follows as in Theorem 2. Verify! 
(2) Writing briefly AB for AN B and A’ for —A, prove that 


(A— B)C = A-(AC’UBC). 
(3) For each I € D, set 
D,;={AED|AIeD, A-IeD}. 


Then prove that if J € C, the set family D; has the properties (i)—(iii) specified 
in the theorem. (Use the set identity (2) for property (iii).) 
Hence by the minimality of D, D C Dy. Therefore, 


(VAED)(VIEC) AleEDand A-TIED. 
(4) Using this, show that D; satisfies (i)—(iii) for any I € D. 


Deduce 
DED; 


so D is closed under finite intersections and differences. 


Combining with property (ii), show that D is a o-ring (see Problem 12 
below). 


2 It may be deferred until Chapter 8, §8, though. 
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By its minimality, D is the smallest o-ring D C (for any other such o-ring 
clearly satisfies (i)—(iii)). 
Thus D = R, as claimed. 
Definition 2. 
Given a set family M, we define (following Hausdorff) 
(a) M, = {all countable unions of M-sets} (cf. C, in §2); 
(b) Ms = {all countable intersections of M-sets}. 


We use M, and Mg, for similar notions, with “countable” replaced by 


“finite.” 
Clearly, 
Me 2 Ms2M 
and 
Meg 2 Mg 2M. 
Why? 


Note 2. Observe that M is closed under finite (countable) unions iff 
M=M; (M=M.,). 
Verify! Interpret M = Mg (M = M,) similarly. 
In conclusion, we generalize Theorem 1 in §1. 


Definition 3. 
The product 


Mx N 
of two set families M and WN is the family of all sets of the form 
Ax B, 
with Ae M and BEN. 
(The dot in x is to stress that M x N is not really a Cartesian product.) 
Theorem 4. If M and WN are semirings, so is M x N. 
The proof runs along the same lines as that of Theorem 1 in §1, via the set 
identities 
ARVIN Sy =A nx) syn) 
and 
(X x Y)—(X’ x Y’) = [(X —X") x Y]U[(XxN XxX’) x (Y -Y’))]. 
The details are left to the reader. 


Note 3. As every ring is a semiring (Corollary 1), the product of two rings 
(fields, o-rings, o-fields) is a semiring. However, see Problem 6 below. 
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Problems on Set Families 
1. Verify Examples (a), (b), and (c). 
1’. Prove Theorem 1 for rings. 


2. Show that in Definition 1 “@ € M” may be replaced by “M 4 0.” 
[Hint: 0 = A— Al] 


=>3. Prove that M is a field (o-field) iff M 4 0, M is closed under finite 
(countable) unions, and 


(VAEM) —-AEM. 
(Hint: A— B= —(-AUB); S=-@| 
4. Prove Theorem 2 for set fields. 
*4’, Does Note 1 apply to semirings? 
5. Prove Note 2. 
5’. Prove Theorem 3 in detail. 


6. Prove Theorem 4 and show that the product M x N of two rings need 
not be a ring. 
[Hint: Let S = E+ and M=N = 2°. Take A,B as in Theorem 1 of §1. Verify that 
A-BEMXN] 
=>7. Let R,R’ be the rings (c-rings, fields, o-fields) generated by M and NV, 
respectively. Prove the following. 
(i) If MCN, then R CR’. 


(ii) If MCN CR, then R= R’. 


(iii) If 
M = {open intervals in E”} 
and 
N = {all open sets in E”}, 
then R = R’. 


[Hint: Use Lemma 2 in §2 for (iii). Use the minimality of R and R’] 

8. Is any of the following a semiring, ring, o-ring, field, or o-field? Why? 
(a) All infinite intervals in E?. 
(b) All open sets in a metric space (5S, p). 
(c) All closed sets in (S, p). 
(d) All “clopen” sets in (S, p). 

e) {X € 25 | —X finite}. 

) 


( 
(f) {X € 2° | —X countable}. 
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=>9. Prove that for any sequence {A,,} in a ring R, there is 
(a) an expanding sequence {B,,} C R such that 


(Vn) B,D An 


U By, = U Ay; and 
(b) a contracting sequence C,, C Ay, with 
()Cn= Aa: 


(The latter holds in semirings, too.) 
[Hint: Set Bn =U? Ag, Cn =] Ar-] 
=>10. The symmetric difference, A A B, of two sets is defined 
AAB=(A-B)U(B-A). 


and 


Inductively, we also set 


1 
A A, = Al 
k=1 
and 
n+1 n 
MN Ay = (A Ar) DN Aecccite 
k= 1 k=1 


Show that symmetric differences 
(i) are commutative, 
(ii) are associative, and 
(iii) satisfy the distributive law: 
(AA B)NC=(ANC)A(BNC). 
[Hint for (ii): Set A’ = —A, A— B = ANB’. Expand (AA B) AC into an expression 
symmetric with respect to A, B, and C|] 
11. Prove that M is a ring iff 
(i) 0EM; 
(ii) (VA,B EM) AABeEM and ANB € M (see Problem 10); 
equivalently, 
(ii) AA Be Mand AUBEM. 


[Hint: Verify that 
AUB=(AAB)A(ANB) 


and 
A-B=(AUB)AB, 
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while 
ANB=(AUB)A(AAB)]] 


12. Show that a set family M # 0 is a o-ring iff one of the following condi- 
tions holds. 
(a) M is closed under countable unions and proper differences (X — Y 
with X DY); 
(b) M is closed under countable disjoint unions, proper differences, 
and finite intersections; or 


(c) M is closed under countable unions and symmetric differences (see 
Problem 10). 


[Hints: (a) X — Y = (X UY) —Y, a proper difference. 
(b) X —Y = X —(XNY) reduces any difference to a proper one; then 


XUY =(X -Y)U(Y — X)U(XNY) 


shows that M is closed under all finite unions; so M is a ring. Now use Corollary 1 
in §1 for countable unions. 


(c) Use Problem 11.] 


13. From Problem 10, treating A as addition and M as multiplication, show 
that any set ring M is an algebraic ring with unity, i.e., satisfies the six 
field axioms (Chapter 2, §§1-4), except V(b) (existence of multiplicative 
inverses). 


14. A set family H is said to be hereditary iff 
(VX EH) (VYCX) Yed. 


Prove the following. 


(a) For every family M C 2°, there is a “smallest” hereditary ring 
H DM (H is said to be generated by M). Similarly for o-rings, 
fields, and o-fields. 


(b) The hereditary o-ring generated by M consists of those sets which 
can be covered by countably many M-sets. 


15. Prove that the field (o-field) in S, generated by a ring (o-ring) R, con- 
sists exactly of all #-sets and their complements in 9’. 


16. Show that the ring R generated by a set family C ¥ 0 consists of all sets 
of the form 


(see Problem 10), where each A, € Cy (finite intersection of C-sets). 
[Outline: By Problem 11, R must contain the family (call it M) of all such A?_, Ax. 
(Why?) It remains to show that M is a ring DC. 
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Write A+ B for AA B and AB for AN B; so each M-set is a “sum” of finitely 
many “products” 
A, Ao:-::An. 


By algebra, the “sum” and “product” of two such “polynomials” is such a polynomial 


itself. Thus 
(VX,YEM) XAY andXnYeEemM. 


Now use Problem 11.] 


17. Use Problem 16 to obtain a new proof of Theorem 2 in §1 and Corollary 2 
in the present section. 
[Hints: For semirings, C = Cg. (Why?) Thus in Problem 16, Az € C. 
Also, 
(VA,BEC) AAB=(A-B)U(B-A) 
where A — B and B — A are finite disjoint unions of C-sets. (Why?) 
Deduce that A A B € C4 and, by induction, 


so RCCLCR. (Why?)] 
18. Given a set A and a set family M, let 
AAM 
be the family of all sets AN X, with X € M; similarly, 
NU (M = A) = {all sets Y U(X — A), with Y EN, X € M}, etc. 
Show that if M generates the ring R, then AMM generates the ring 
R' =ANR. 


Similarly for o-rings, fields, o-fields. 
[Hint for rings: Prove the following. 
(i) AAR is a ring. 
(ii) MC R’U (R= A), with R’ as above. 
(iii) RU (R = A) is a ring (call it V). 
(iv) By (ii), RO N,so ANRCAAN CR’. 
(v) ANRDR’ (for ANR DAMM). 
Hence R’ = AN R.] 


§4. Set Functions. Additivity. Continuity 


I. The letter “v” in vA may be treated as a certain function symbol that assigns 
a numerical value (called “volume” ) to the set A. So far we have defined such 
“volumes” for all intervals, then for C-simple sets, and even for C,-sets in E”. 
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Mathematically this means that the volume function v has been defined first 
on C (the intervals), then on C/ (C-simple sets), and finally on C,. 

Thus we have a function v which assigns values (“volumes”) not just to 
single points, as ordinary “point functions” do, but to whole sets, each set 
being treated as one thing. 

In other words, the domain of the function v is not just a set of points, but 
a set family (C, Cl, or C,). 

The “volumes” assigned to such sets are the function values (for C and C{-sets 
they are real numbers; for C,-sets they may reach +00). This is symbolized by 


eg ae he 
or 
v: Cg > E*; 
more precisely, 
v: Cg — [0, oo], 


since volume is nonnegative. 


It is natural to call v a set function (as opposed to ordinary point functions). 
As we shall see, there are many other set functions. The function values need 
not be real; they may be complex numbers or vectors. This agrees with our 
general definition of a function as a certain set of ordered pairs (Definition 3 
in Chapter 1, §§4-7); e.g., 


fa SB Ee 
P= Nol wB oC ar )° 
Here the domain consists of certain sets A, B,C,.... This leads us to the 
following definition. 


Definition 1. 


A set function is a mapping 
s:M—-E 


whose domain is a set family M. 


The range space EF is assumed to be E!, E*, C (the complex field), E”, 
or another normed space. Thus s may be real, extended real, complex, 
or vector valued. 


To each set X € M, the function s assigns a unique function value 
denoted s(X) or sX (which is an element of the range space F). 


We say that s is finite on a set family VN C M iff 
(VX EN) |sX| < co; 


briefly, |s| < oo onN. (This is automatic if s is complex or vector valued.) 
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We call s semifinite if at least one of oo is excluded as function value, 
e.g., if s > 0 on M; ice., 
s: M = (0, co]. 
(The symbol co stands for +00 throughout.) 


Definition 2. 
A set function 
s: ME 
is called additive (or finitely additive) on N C M iff for any finite disjoint 
union |), Ax, we have 


S "Ag = s(Uar). 
k k 
provided ),, Ax and all the A, are N-sets. 

If this also holds for countable disjoint unions, s is called o-additive 
(or countably additive or completely additive) on N. 

If V = M here, we simply say that s is additive (c-additive, respec- 
tively). 


Note 1. As L) Ax is independent of the order of the Az, o-additivity pre- 
supposes and implies that the series 


\ sAk 


is permutable (§2) for any disjoint sequence 
{Ag} GN: 


(The partial sums do exist, by our conventions (2*) in Chapter 4, §4.) 
The set functions in the examples below are additive; v is even o-additive 
(Corollary 1 in §2). 
Examples (b)—(d) show that set functions may arise from ordinary “point 
functions.” 
Examples. 
(a) The volume function v: C — E! on C (= intervals in E”), discussed 
above, is called the Lebesgue premeasure (in E”). 
(b) Let M = {all finite intervals J Cc E'}. 
Given f: E+ — E, set 


(VIEM) sl=Vy[I], 


the total variation of f on the closure of I (Chapter 5, §7). 
Then s: M — [0,00] is additive by Theorem 1 of Chapter 5, §7. 
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(c) Let M and f be as in Example (b). 
Suppose f has an antiderivative (Chapter 5, §5) on E*. For each 
interval X with endpoints a,b € E' (a < b), set 


xe fs 


This yields a set function s: M — E (real, complex, or vector valued), 
additive by Corollary 6 in Chapter 5, 85. 


(d) Let C = {all finite intervals in E‘}. 


Suppose 
a: Ei = # 


has finite one-sided limits 
a(p+) and a(p—) 
at each p € E'. The Lebesgue—Stieltjes (LS) function 
s,:Co E 
(important for Lebesque—Stieltjes integration) is defined as follows. 
Set 5,9 = 0. For nonvoid intervals, including |a,a] = {a}, set 
Sq(a, 6] = a(b+) — a(a—), 
Sq (a, b] = a(b+) — a(a+), 
Sq|a, b) = a(b—) — a(a—), and 
Sq(a, b) = a(b—) — a(at). 
For the properties of sg see Problem 7 ff., below. 


Let mX be the mass concentrated in the part X of the physical space S. 
Then m is a nonnegative set function defined on 


2° = {all subsets X C S} (§3). 


—~ 
oO 
ee 


If instead mX were the electric load of X, then m would be sign 
changing. 


II. The rest of this section is redundant for a “limited approach.” 
Lemmas. Let s: M — E be additive on N C M. Let 


A,BEN, ACB. 


Then we have the following. 
(1) If |sA| < co and B—AEWN, then 


s(B — A) = sB—sA (“subtractivity” ). 
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(2) If DEN, then s@ = 0 provided |sX| < 00 for at least one X EN. 
(3) If N is a semiring, then sA = +00 implies |sB| = oo. Hence 
|sB| < co = |sAl < 00. 
If further s is semifinite then 
sA.= 06> 6B S00 


(same sign). 
Proof. 
(1) As BD A, we have 
B=(B-A)UA (disjoint); 
so by additivity, 
sB = s(B — A)+sA. 
If |sA| < oo, we may transpose to get 
sB—sA=s(B —- A), 
as claimed. 
(2) Hence 
sf = s(X —X) =sX —sX =0 
if X, 0 EN, and |sX| < oc. 
(3) If V is a semiring, then 


B—A= |) Ag (disjoint) 
k=1 


for some V-sets Az; so 
B= AU |) Ak (disjoint). 
k=1 
By additivity, 
sB=sA+ s- SAR; 
k=1 
so by our conventions, 


|sA|.= co = |sBl = co. 


If, further, s is semifinite, one of too is excluded. Thus sA and sB, if 
infinite, must have the same sign. This completes the proof. 
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In §81 and 2, we showed how to extend the notion of volume from intervals 
to a larger set family, preserving additivity. We now generalize this idea. 


Theorem 1. I/f 
s: CoE 

is additive on C, an arbitrary semiring, there is a unique set function 
5:C, 7 E, 

additive on C,, with 5 = s on C, 1.e., 


sX =sxX for X EC. 


We call § the additive extension of s to C; = Cl (Corollary 2 in §3). 


Proof. If s > 0 (s: C — [0,co]), proceed as in Lemma 1 and Corollary 2, all 
of §1. 

The general proof (which may be omitted or deferred) is as follows. 

Each X € C! has the form 


X =|) Xj (disjoint), Xi €C. 
i=1 


Thus if 5 is to be additive, the only way to define it is to set 


sX = 3 sX;. 
i=1 


This already makes 5 unique, provided we show that 


3 sX; 
i=1 


does not depend on the particular decomposition 


rome 
7=1 


(otherwise, all is ambiguous). 
Then take any other decomposition 
A= U Y, (disjoint), Y, EC. 
k=1 
Additivity implies 
(Vi,k) sX;= 0 s(X;Y,) and s¥, = S > s(XiN Yi). 
k=1 i=1 
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(Verify!) Hence 
S 9 sXi = So 8(XiN Yu) = ar 


Thus, indeed, it does not matter which particular decomposition we choose, 
and our definition of 5 is unambiguous. 

If X € C, we may choose (say) 

1 
X= |) Xe am, 
i=l 
so 
sX = 5X1 = sX; 

ie., 5=s on C, as required. 

Finally, for the additivity of 5, let 


A= U By, (disjoint), A, By € Cl. 
K=1 


Here we may set 


Nk 
Br = (J Cri (disjoint), Cri €C. 
i=l 
Then 
A= U Ci (disjoint); 
kyi 


so by our definition of 5, 


sA= S > sChi — (5: SCs) = 3 SBr, 
ki k=1 


k=1 


as required. 


Continuity. We write X, 7 X to mean that 


and {X,}T, ie., 


Similarly, X, \, X iff 
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and {Xn} , ie., 
Xn 2 Xn41; (al Bee? ener 
In both cases, we set 
X= lim Xp. 
This suggests the following definition. 
Definition 3. 
A set function s: M — E is said to be 
(i) left continuous (on M) iff 


sX = lim sx, 


whenever X, “7 X and X,X, € M; 
(ii) right continuous iff 


sX = lim sx, 


n—- co 


whenever X, \, X, with X,X, € M and |sX,| < oo. 


Thus in case (i), 


[ee) 
lim sx, =s U Xn 
n—-oo nat 
if all X,, and U7, X, are M-sets. 
In case (ii), 
CO 
lim sX, =s () Xin 
n—- oo pad. 
if all X,, and (\7~_, X» are in M, and |sXj| < oo. 
Note 2. The last restriction applies to right continuity only. (We choose 
simply to exclude from consideration sequences {X,,}|, with |sX,| = oo; see 
Problem 4.) 


Theorem 2. If s:C — E is a-additive and semifinite on C, a semiring, then 
s is both left and right continuous (briefly, continuous). 


Proof. We sketch the proof for rings; for semirings, see Problem 1. 
Left continuity. Let X, 7 X with X,,X € C and 


X= U & 


If sX, = +00 for some n, then (Lemma 3) 


sX = sX, = +00 form>n, 
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since X D Xy, D Xn; So 


lim sX,,, = too = sX, 


as claimed. 
Thus assume all sX,, finite; so s@ = 0, by Lemma 2. 
Set Xo = 0. As is easily seen, 


X = | Xn = U (Xn — Xn-1) (disjoint), 
n=1 n=1 
and 
(Vn) Xp —Xn-1 €C (a ring). 
Also, 


(Vm>n) Xm = (J (Xn — Xn-1) (disjoint). 


r=] 


(Verify!) Thus by additivity, 


and by the assumed o-additivity, 


sX =8|)(Xn—Xn-1) = >) 8(Xn — Xn-1) 
n=1 n=1 
= lim S° 8(Xn — Xn-1) = lim sX~n, 
n=1 
as claimed. 
Right continuity. Let X, \, X with X, Xn €C, 
eo ape 
n=1 

and 

|sX1| < oo. 


As X C X, C X1, Lemma 3 yields that 
(Vn) |sXn| < co 


and |sX| < oo. 
As 


X= A) en 
al 
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we have 


(Vn) Xn=XU |) (Xe-1— Xx) (disjoint). 
k=n+1 


(Verify!) Thus by o-additivity, 


(Vn) sX,=sX+ > s(Xp-1 — Xx), 
k=n+1 
with |sX| < co, |sX;,| < 00 (see above). 
Hence the sum 


[oe) 


NS) 8(Xk-1 — Xz) = 8X, — 8X 
k=n+1 


is finite. Therefore, it tends to 0 as n — oo (being the “remainder term” of a 
convergent series). Thus n — oo yields 


lim sX, =sX +lim S> s(X,_1 — Xz) = 8X, 


n—-co 
k=n+1 


as claimed. 


Problems on Set Functions 


1. Prove Theorem 2 in detail for semirings. 
[Hint: We know that 


Xn — Xn-1 = LJ Yni (disjoint) 
w=1 


for some Yn; € C, so 
mn 


B(Xn — Xn-1) = > 8Ynis 
i=1 


with 5 as in Theorem 1.] 


2. Let s be additive on M, a ring. Prove that s is also o-additive provided 
s is either 


(i) left continuous, or 


(ii) finite on M and right-continuous at 0; i.e., 


lim sX, =0 


n—- co 


when X, \, 0 (Xn € M). 


[Hint: Let 
A=\|JAn (disjoint), A,An € M. 
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Set 2 
Xn = (J Ak, Yn = A- Xn 
k=1 

Verify that Xn, Yn € M, Xn 7A, Yn \ @. 

In case (i), 

sA=limsXxXn = ye sAk. 
k=1 

(Why?) 

For (ii), use the Yp.] 

. Let 
M = {all intervals in the rational field RC E'}. 

Let 


sX =b-—a 
if a,b are the endpoints of X € M (a,b € R, a< b). Prove that 
(i) M is a semiring; 
(ii) s is continuous; 
(iii) s is additive but not o-additive; thus Problem 2 fails for semirings. 


[Hint: R is countable. Thus each X € M is a countable union of singletons {x} = 
[x, x]; hence sX = 0 if s were o-additive.] 


. Let N = {naturals}. Let 


M = {all finite subsets of N and their complements in N}. 
If X € M, let sX = 0 if X is finite, and sX = oo otherwise. Show that 
(i) M is a set field; 
(ii) s is right continuous and additive, but not o-additive. 


Thus Problem 2(ii) fails if s is not finite. 


. Let 


C = {finite and infinite intervals in E'}. 


If a,b are the endpoints of an interval X (a,b € E*, a < b), set 


ak a<o0, 
sX = 


0, a= 0. 
Show that s is o-additive on C, a semiring. 
Let 
Xj, HOO); 


so sX, =0o —-n = co and X, \, O. (Verify!) Yet 
lim sX, = 00 # sO. 
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=>7. 


Does this contradict Theorem 2? 


. Fill in the missing proof details in Theorem 1. 


. Let s be additive on M. Prove the following. 


(i) If M is a ring or semiring, so is 
N={X €M||sX| < co} 
if NV AQ. 


(ii) If M is generated by a set family C, with |s| < oo on C, then 
|s|] <coonM. 
[Hint: Use Problem 16 in §3.] 


(Lebesgue-Stieltjes set functions.) Let a and sq be as in Example (d). 
Prove the following. 


(i) sq > 0 on C iff at on E! (see Theorem 2 in Chapter 4, §5). 
(ii) sa{p} = sa[p, p] = 0 iff a is continuous at p. 
(iii) sq is additive. 
[Hint: If 
A= L) A; (disjoint), 
i=1 
the intervals A;_1, A; must be adjacent. For two such intervals, consider all 


cases like 
(a, 8] U (b, ©), [a, b) U [b, dete. 


Then use induction on n.] 


(iv) If a is right continuous at a and b, then 
Sq(a, b] = a(b) — a(b). 
If a is continuous at a and b, then 
Sq[a, b] = 5a(a, 6] = sq[a,b) = sq(a, b). 


(v) If af on E£', then sq satisfies Lemma 1 and Corollary 2 in §1 
(same proof), as well as Lemma 1, Theorem 1, Corollaries 1-4, 
and Note 3 in §2 (everything except Corollaries 5 and 6). 

[Hint: Use (i) and (iii). For Lemma 1 in 82, take first a half-open B = (a, b]; use 
the definition of a right-side limit along with Theorems 1 and 2 in Chapter 4, 
85, to prove 


(Ve>0) Ge>b) 0< a(c—)—a(b+) <eé; 


then set C = (a,c). Similarly for B = [a,b), etc. and for the closed interval 
ACB] 


(vi) If a(x) = x then sq = v, the volume (or length) function in E'. 
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8. Construct LS set functions (Example (d)), with aT (see Problem 7(v)), 
so that 
(i) sa[0, 1] F soll, 2]; 
(ii) s. £1 =1 (after extending s, to C,-sets in E"); 
(ii!) s.H1 = for a fixed c € (0,00); 
(iii) sa {0} = 1 and s,[0,1] > sq(0, 1]. 


Describe sq if a(x) = [a] (the integral part of 2). 
[Hint: See Figure 16 in Chapter 4, §1.] 


9. For an arbitrary a: E' — E', define og: C > E' by 
Fala, b] = Fo(4, 6] = oo[a,b) = 7a(a,b) = a(b) — a(a) 


(the original Stieltjes method). Prove that oq is additive but not o- 
additive unless a is continuous (for Theorem 2 fails). 


§5. Nonnegative Set functions. Premeasures. Outer Measures 


We now concentrate on nonnegative set functions 
m:M = [0,00] 


(we mostly denote them by m or yz). Such functions have the advantage that 


3 MX y, 
n=1 


exists and is permutable (Theorem 2 in §2) for any sets X, € M, since mX,, > 
0. Several important notions apply to such functions (only). They “mimic” 
881 and 2. 


Definition 1. 


A set function 
m:M — (0, co] 


is said to be 
(i) monotone (on M) iff 


mxX <myY 


whenever 
X CY and X,Y eM; 
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(ii) (finitely) subadditive (on M) iff for any finite union 


we have 


whenever X,Y; € M and 


x U Y;, (disjoint or not); 
k=1 


(iii) o-subadditive (on M) iff (1) holds for countable unions, too. 


Recall that {Y;,} is called a covering of X iff 


LE| Ms 
k 


We call it an M-covering of X if all Y;, are M-sets. We now obtain the following 
corollary. 


Corollary 1. Subadditivity implies monotonicity. 
Take n = 1 in formula (1). 


Corollary 2. Ifm:C — [0, co] is additive (o-additive) on C, a semiring, then 
m is also subadditive (o-subadditive, respectively), hence monotone, on C. 


The proof is a mere repetition of the argument used in Lemma | in 81. 
Taking n = 1 in formula (ii) there, we obtain finite subadditivity. 


For o-subadditivity, one only has to use countable unions instead of finite 
ones. 


Note 1. The converse fails: subadditivity does not imply additivity. 
Note 2. Of course, Corollary 2 applies to rings, too (see Corollary 1 in §3). 
Definition 2. 
A premeasures is a set function 
pu: C = (0, co] 


such that 
0 €C and pb =0. 


(C may, but need not, be a semiring.) 
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A premeasure space is a triple 
(S,C, p2), 
where C is a family of subsets of S (briefly, C C 2°) and 
Lu: C — [0,00] 


is a premeasure. In this case, C-sets are also called basic sets. 
If 
AG|JBn 


with B, € C, the sequence {B,,} is called a basic covering of A, and 
HB, 


is a basic covering value of A; {B,} may be finite or infinite. 


Examples. 


(a) The volume function v on C (= intervals in E”) is a premeasure, as v > 0 
and vf = 0. (E”,C,v) is the Lebesgue premeasure space. 


(b) The LS set function s, is a premeasure if aT (see Problem 7 in §4). We 
call it the a-induced Lebesque-Stieltjes (LS) premeasure in E'. 
We now develop a method for constructing o-subadditive premeasures. (This 
is a first step toward achieving o-additivity; see §4.) 
Definition 3. 


For any premeasure space (.5,C, y), we define the j1-induced outer measure 
m* on 2° (= all subsets of ) by setting, for each A C S, 


(2) mA= mt uBn 


AC\|JBn, Bec}, 


i.e., m*A (called the outer measure of A) is the glb of all basic covering 
values of A. 


If uw =v, m* is called the Lebesgue outer measure in E”. 


Note 3. If A has no basic coverings, we set m*A = oo. More generally, we 
make the convention that inf) = +00. 


Note 4. By the properties of the glb, we have 
(VACS) 0<m*A. 
If A €C, then {A} is a basic covering; so 
mA < pA. 
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In particular, m*0 = yO = 0. 
Theorem 1.! The set function m* so defined is o-subadditive on 2°. 


Proof. Given 
AC|J4AncS, 


we must show that 


mA< > m* An. 


This is trivial if m*A,, = co for some n. Thus assume 
(Vn) m*An < 00 
and fix e > 0. 
By Note 3, each A, has a basic covering 
{Brel BH 1,p2s 2s 
(otherwise, m*A, = co). By properties of the glb, we can choose the Bn, 
so that : 


(Vn) Yo HBr <m* An + Bn 


k 


(Explain from (2)). The sets B,, (for all n and all &) form a countable basic 
covering of all A,, hence of A. Thus by Definition 3, 


mA< Os Box) < Y(m An + =] < Som" An +e. 
n k n 


As ¢ is arbitrary, we can let ¢ — 0 to obtain the desired result. 


Note 5. In view of Theorem 1, we now generalize the notion of an outer 
measure in S to mean any o-subadditive premeasure defined on all of 2°. 


By Note 4, m* < p on C, not m* = pw in general. However, we obtain the 
following result. 


Theorem 2. With m* as in Definition 3, we have m* = pw on C iff pu is 
a-subadditive on C. Hence, in this case, m* is an extension of [. 


Proof. Suppose p is o-subadditive and fix any A € C. By Note 4, 
m*A < pA. 

We shall show that 
pA <m*A, 


1 Theorems 1-3 are redundant for a “limited approach” (see the preface). Pass to Chap- 
ter 8, §1. 
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too, and hence wA = m*A. 
Now, as A € C, A surely has basic coverings, e.g., {A}. Take any basic 
covering: 


AC(JBn, Beer 


As pL is o-subadditive, 
pA<S 7 uBn. 


Thus wA does not exceed any basic covering values of A; so it cannot exceed 
their glb, m*A. Hence u = m*, indeed. 

Conversely, if ~ = m* on C, then the o-subadditivity of m* (Theorem 1) 
implies that of 4 (on C). Thus all is proved. 


Note 6. If, in (2), we allow only finite basic coverings, then the i-induced 
set function is called the p-induced outer content, c*. It is only finitely subad- 
ditive, in general. 

In particular, if 4 = v (Lebesgue premeasure), we speak of the Jordan outer 
content in E”. (It is superseded by Lebesgue theory but still occurs in courses 
on Riemann integration.) 

We add two more definitions related to the notion of coverings. 
Definition 4. 


A set function s: M > E (M C 2°) is called o-finite iff every X € M 
can be covered by a sequence of M-sets X,,, with 


|sXn|<oo (Vn). 


Any set A C S which can be so covered is said to be o-finite with 
respect to s (briefly, (s) o-finite). 
If the whole space S can be so covered, we say that s is totally o-finite. 
For example, the Lebesgue premeasure v on E” is totally o-finite. 


Definition 5. 


A set function s: M — E* is said to be regular with respect to a set 
family A (briefly, A-regular) iff for each A € M, 


(3) sA=inf{sX | AC X, X € A}; 
that is, sA is the glb of all sX, with AC X and X € A. 


These notions are important for our later work. At present, we prove only 
one theorem involving Definitions 3 and 5. 
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Theorem 3. For any premeasure space (5,C,), the p-induced outer measure 


* 


m* is A-regular whenever 
Ge Ae. 
Thus in this case, 


(4) (VACS) m*A=inf{m*X | AC X, X © A}. 


Proof. As m* is monotone, m*A is surely a lower bound of 
{m*X | AC X, X € A}. 
We must show that there is no greater lower bound. 
This is trivial if m*A = oo. 
Thus let m*A < 00; so A has basic coverings (Note 3). Now fix any ¢ > 0. 
By formula (2), there is a basic covering {B,,} C C such that 


AC\JB, 


and 
mA+te> y Bs > Sms, > (sel eee 


* 


is o-subadditive!) 
Let 


(m 


a ese 


Then X is in C,, hence in A, and AC X. Also, 
mAte>m* xX. 
Thus m*A +e is not a lower bound of 


{m*X|ACX, Xe Ah. 


This proves (4). 


Problems on Premeasures and Related Topics 


1. Fill in the missing details in the proofs, notes, and examples of this 
section. 


2. Describe m* on 2° induced by a premeasure ju: C > E* such that each 
of the following hold. 


(b) C = {S,0, and all singletons}; uS = co, p{x} = 1. 
(c) C as in (b), with S uncountable; wS = 1, and wX = 0 otherwise. 
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(d) C = {all proper subsets of S}; wX =1 when c X CS; ph =0. 
3. Show that the premeasures 
v': C’ = [0, co] 


induce one and the same (Lebesgue) outer measure m* in EF”, with 
v’ =v (volume, as in §2): 


(a) C’ = {open intervals}; 
( 


) 
(c) 
(d) C= Ce 
(e) C’ = {open sets}; 
(f) C’ = {half-open cubes}. 


[Hints: (a) Let m’ be the v/-induced outer measure; let C = {all intervals}. As 
C’ CC, m'/A>m*A. (Why?) Also, 


(Ve > 0) 


— 


A{Be} CC) AC(UJBy and So vB, < m*A+e. 
k 


(Why?) By Lemma 1 in §2, 


— 


F{Cy} CC’) By C Cy and vB, + sr > Cp. 


Deduce that m*A > m’A, m* = m’. Similarly for (b) and (c). For (d), use 
Corollary 1 and Note 3 in §1. For (e), use Lemma 2 in §2. For (f), use Problem 2 
in §2.] 


3’. Do Problem 3(a)-(c), with m* replaced by the Jordan outer content c* 
(Note 6). 


4. Do Problem 3, with v and m* replaced by the LS premeasure and outer 
measure. (Use Problem 7 in 84.) 


5. Show that aset A C FE” is bounded iff its outer Jordan content is finite. 
6. Find a set A C E! such that 


(i) its Lebesgue outer measure is 0 (m*A = 0), while its Jordan outer 
content c*A = o; 
(ii) m*A = 0, c*A = 1 (see Corollary 6 in §2). 


7. Let 
M1, ba: Cc [0, oo] 


be two premeasures in S and let mj and m5 be the outer measures 
induced by them. 


Prove that if mt = m3 on C, then mj = mi on all of 2°. 
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8. With the notation of Definition 3 and Note 6, prove the following. 
(i) If AC BCS and m*B =0, then m*A = 0; similarly for c*. 
[Hint: Use monotonicity.] 
(ii) The set family 
{xX CS|c*A=0} 
is a hereditary set ring, i.e., a ring R such that 
(VBER)(VACB) AER. 
(iii) The set family 
{X CS |m*X =0} 
is a hereditary o-ring. 
(iv) So also is 
H = {those X C S that have basic coverings}; 


thus H is the hereditary o-ring generated by C (see Problem 14 
in §3). 
9. Continuing Problem 8(iv), prove that if jz is o-finite (Definition 4), so is 
m* when restricted to H. 
Show, moreover, that if C is a semiring, then each X € H has a basic 


covering {Y,,}, with m*Y,, < oo and with all Y,, disjoint. 
[Hint: Show that 


for some sets Bn, € C, with wBnr, < co. Then use Note 4 in §5 and Corollary 1 
of §1.] 
10. Show that if 
s:C— E* 


is o-finite and additive on C, a semiring, then the o-ring R generated 
by C equals the o-ring R’ generated by 


C’={X €C| |sX| < co} 


(cf. Problem 6 in §4). 
[Hint: By o-finiteness, 


(VX €C) (A{An} CC||sAn| <0) X C|JAn; 


n 


so 
X=(J(XnAn), XNAnEC’. 


n 


(Use Lemma 3 in §4.) 
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11. 


12. 


=>*13. 


14. 
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Thus (VX € C) X is a countable union of C’-sets; so C C R’. Deduce R C R’. 
Proceed.] 


With all as in Theorem 3, prove that if A has basic coverings, then 
(ABeEAs) AC Band m*A=m‘B. 


[Hint: By formula (4), 


1 
(Vn EN) (AXn€A|ACXn) m*A<mXy, <m*At—. 
n 
(Explain!) Set 


B= (| * € As. 


Proceed. For As, see Definition 2(b) in §3.] 


Let (S,C, 4) and m* be as in Definition 3. Show that if C is a o-field in 
S, then 


(VACS)(ABEC) ACBandm*A=uB. 


[Hint: Use Problem 11 and Note 3.] 


Show that if 
s:CoE 


is o-finite and o-additive on C, a semiring, then s has at most one o- 
additive extension to the o-ring R generated by C. 
(Note that s is automatically o-finite if it is finite, e.g., complex or 
vector valued.) 
[Outline: Let 
s,s": ROE 


be two o-additive extensions of s. By Problem 10, R is also generated by 
C'={X EC | |sX| < oo}. 


Now set 
R* ={X ER|s'X =s8"X}. 


Show that R* satisfies properties (i)—(iii) of Theorem 3 in §3, with C replaced by C’; 
so R = R*.] 


Let m* (n =1,2,...) be outer measures in S such that 
(VXCS) Vn) mix < mi. 
Set 


* 4s * 
po = im m,; 


n—- oo 


Show that y* is an outer measure in S (see Note 5). 
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15. An outer measure m* in a metric space (5,9) is said to have the 
Carathéodory property (CP) iff 
m(X UY) > m*X + m*Y 
whenever p(X, Y) > 0, where 
p(X, Y) = inf{p(a, y) |e e X,y € Y}. 


For such m*, prove that 
m (U Xx) = Sim"X; 
k k 


if. {X;)-C 2° and 
p(Xi, Xk) >0 GF). 


[Hint: For finite unions, use the CP, subadditivity, and induction. Deduce that 


(Vn) os m* Xp <m* U) Xp. 
k=1 k=1 


Let n — oo. Proceed.] 


16. Let (5,C, 41) and m* be as in Definition 3, with p a metric for S. Let fy, 


be the restriction of yz to the family C,, of all X € C of diameter 
1 
dX <-. 
n 


Let m*, be the 4,-induced outer measure in S. 
Prove that 


(i) {m*}7 as in Problem 14; 

(ii) the outer measure 
pe = jim ms, 

has the CP (see Problem 15), and 
pb =m on 2”. 
[Outline: Let p(X,Y) >¢ >0 (X,Y CS). 
If for some n, X UY has no basic covering from Cy, then 
W(X UY) > me(XUY) = co > p*X 4 *Y, 


and the CP follows. (Explain!) 
Thus assume 


(vn = =) (Vk) (ABnk €Cn) XUYC UJ Bay 
k=1 
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One can choose the Bynx so that 
ve LMBnk <me(X UY) +e. 
k=1 

(Why?) As 


1 
dBnk SS 5 gE, 
n 


some Bnx cover X only, others Y only. (Why?) Deduce that 
1 2 * = 2 
(vn >=) mhX+mhY < Do unBag <mi(XUY) te. 
E 
k=1 


Let « — 0 and then n > oo. 
Also, m* < m* < p*. (Why?)] 


Continuing Problem 16, suppose that 


(Ve >0) (Vn,k) (VB EC) (ABnk € Cn) 


BC ii Bn, and uB+e> So uBnk- 
k=1 k=1 


Show that 
m* = lim by =H", 


noo 


so m* itself has the CP. 
[Hints: It suffices to prove that m*A > p*A if m*A < co. (Why?) 


Now, given e > 0, A has a covering 
{Bi} Cc 


such that 
m*Ate> a pB;. 


(Why?) By assumption, 


(Vn) By C LJ Bi, € Cn and pB, + x > So uBi,. 


Deduce that 


Let ¢ — 0; then n > oo] 


Using Problem 17, show that the Lebesgue and Lebesgue—Stieltjes outer 
measures have the CP. 


§6. Measure Spaces. More on Outer Measures 147 


§6. Measure Spaces. More on Outer Measures! 


I. In 85, we considered premeasure spaces, stressing mainly the idea of o- 
subadditivity (Note 5 in §5). Now we shall emphasize o-additivity. 
Definition 1. 

A premeasure 

m: M — [0, co] 
is called a measure (in S) iff M is a a-ring (in S), and m is o-additive 
on M. 
If so, the system 
(S,M,m) 


is called a measure space; mX is called the measure of X € M; M-sets 
are called m-measurable sets. 


Note that m is nonnegative and m@ = 0, as m is a premeasure (Definition 2 
in §5). 
Corollary 1. Measures are a-additive, o-subadditive, monotone, and contin- 


uous. 


Proof. Use Corollary 2 in 85 and Theorem 2 in 84, noting that M is a o- 
ring. 


Corollary 2. In any measure space (S,M,m), the union and intersection of 
any sequence of m-measurable sets is m-measurable itself. So also is X —Y if 
X,Y EM. 


This is obvious since M is a o-ring. 
As measures and other premeasures are understood to be > 0, we often write 


m: M— E* 


for 
m: M = (0, oo]. 
We also briefly say “measurable” for “m-measurable.” 
Note that @ € M, but not always S € M. 


Examples. 


(a) The volume of intervals in E” is a o-additive premeasure, but not a 
measure since its domain (the intervals) is not a o-ring. 


(b) Let M = 2°. Define 
(VXCS) mX=0. 


' Sections 6-12 are not needed for a “limited approach.” (Pass to Chapter 8, §1.) 
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Then m is trivially a measure (the zero-measure). Here each set X C S 
is measurable, with mX = 0. 


(c) Let again M = 2°. Let mX be the number of elements in X, if finite, 
and mX = oo otherwise. 
Then m is a measure (“counting measure” ). Verify! 


(d) Let M = 2°. Fix some p € S. Let 
1 ifpe xX, 
es { 0 ae 
Then m is a measure (it describes a “unit mass” concentrated at p). 
(e) A probability space is a measure space (S,M,m), with 
SeM andmS = 1. 


In probability theory, measurable sets are called events; mX is called the 
probability of X, often denoted by pX or similar symbols. 


In Examples (b), (c), and (d), 
M = 2° (all subsets of S). 


More often, however, 


M £25, 


i.e., there are nonmeasurable sets X C S for which mX is not defined. 

Of special interest are sets X € M, with mX = 0, and their subsets. We 
call them m-null or null sets. One would like them to be measurable, but this 
is not always the case for subsets of X. 


This leads us to the following definition. 
Definition 2. 


A measure m: M — E* is called complete iff all null sets (subsets of sets 
of measure zero) are measurable. 


We now develop a general method for constructing complete measures. 


II. From 85 (Note 5) recall that an outer measure in S is a o-subadditive 
premeasure defined on all of 2° (even if it is not derived via Definition 3 in §5).? 
In Examples (b), (c), and (d), m is both a measure and an outer measure. 
(Why?) 
An outer measure 
mm: 2? 


2 Some authors consider outer measures on smaller domains; we shall not do so. 
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need not be additive; but consider this fact: 
Any set A C S splits S into two parts: A itself and —A. 
It also splits any other set X into X 1 A and X — A; indeed, 
X =(XNA)U(X — A) (disjoint). 


We want to single out those sets A for which m* behaves “additively,” i.e., 
so that 


m* XK =m*(X NA) +m*(X — A). 
This motivates our next definition. 


Definition 3. 


Given an outer measure m*: 2° — E* and a set A C S, we say that A is 
m*-measurable iff all sets X C S' are split “additively” by A; that is, 


(1) (VX CS) m*X =m*(XNA)+m*(X — A). 
As is easily seen (see Problem 1), this is equivalent to 
(2) (VX CA) (VY C-A) m(XUY)=m*X+m’'Y. 


The family of all m*-measurable sets is usually denoted by M*. The 
system (5, M*,m*) is called an outer measure space. 


Note 1. Definition 3 applies to outer measures only. For measures, “m- 
measurable” means simply “member of the domain of m” (Definition 1). 


Note 2. In (1) and (2), we may equivalently replace the equality sign (=) 
by (>). Indeed, X is covered by 


iXnA xX =A}, 


and X UY is covered by {X,Y}; so the reverse inequality (<) anyway holds, 
by subadditivity. 
Our main objective is to prove the following fundamental theorem. 


Theorem 1. In any outer measure space 
(S, MM"; m*), 


the family M* of all m*-measurable sets is a o-field in S, and m*, when re- 
stricted to M*, is a complete measure (denoted by m and called the m*-induced 
measure; som* =m on M*). 


We split the proof into several steps (lemmas). 


150 Chapter 7. Volume and Measure 


Lemma 1. M* is closed under complementation: 


(VAEM*) -—-AEM’. 


Indeed, the measurability criterion (2) is same for A and —A alike. 
Lemma 2. @) and S are M*-sets. So are all sets of outer measure 0. 
Proof. Let m*A =0. To prove A € M*, use (2) and Note 2. 

Thus take any X C A and Y C —A. Then by monotonicity, 

m*X <m*A=0 
and 
mY <m*(X UY). 
Thus 
mX+m*Y=04+mY <m*(X UY), 


as required. 
In particular, as m*@ = 0, 0 is m*-measurable (@ € M*). 


So is S' (the complement of 0) by Lemma 1. 


Lemma 3. M* is closed under finite unions: 
(VA,BeEeM*) AUBEM"*. 
Proof. This time we shall use formula (1). By Note 2, it suffices to show that 
(VX CS) m*X >m*(XN(AUB))+m*(X —- (AU B)). 
Fix any X C S; as A € M*, we have 
(3) m*X =m*(XM A)+m*(X — A). 
Similarly, as B € M*, we have (replacing X by X — A in (1)) 
(4) m*(X — A) =m*((X — A)N B)+m*(X —A-B) 
=m" (XN—-AN B)+m*(X —-(AUB)), 


X-A=XN-A 


and 
X-A-B=X-—(AUB). 


Combining (4) with (3), we get 
(5) mX=m* (XN A)+m*(XN-AN B)+m*(X — (AUB)). 
Now verify that 
(XN AJU(XN-ANB)DXN(AUB). 
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As m is subadditive, this yields 
m(XNA)+tm*(XN-ANB)>m*(XN(AUB)). 
Combining with (5), we get 
m'X >m"(X (AU B))+m*(X — (AU B)), 


so that AU B € M*, indeed. 


Induction extends Lemma 3 to all finite unions of M*-sets. 
Note that by Problem 3 in 83, M* is a set field, hence surely a ring. Thus 
Corollary 1 in §1 applies to it. (We use it below.) 


Lemma 4. Let 
X,C Ap CS, k=0,1,2,..., 


with all Ay, pairwise disjoint. 
Let A, € M* fork >1. (Ao and the X;, need not be M*-sets.) Then 


k=0 k=0 
Proof. We start with two sets, Ag and Aj; so 
ALE M*, Ap N A, = 0, Xo C Ap, and X; C Aj. 
As Ag M A; = @, we have Ag C —Aj; hence also Xg C — A}. 
Since A; € M*, we use formula (2), with 
X= X1 C Ay and Y = Xj C —A, 
to obtain 
m* (Xo U X1) =m* Xo +m* Xj. 


Thus (6) holds for two sets. 
Induction now easily yields 


Cn) Sim xe=m*(U xe) <m-(U xi) 
k=0 k=0 k=0 
by monotonicity of m*. Now let n — co and pass to the limit to get 
5 m*X, < m(U Xi). 
k=0 k=0 


As [J Xx is covered by the Xx, the o-subadditivity of m* yields the reverse 
inequality as well. Thus (6) is proved. 
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Proof of Theorem 1. As we noted, M* is a field. To show that it is also 
closed under countable unions (a o-field), let 


U= LJ Ae. Ay & MC. 
k=1 
We have to prove that U € M*; or by (2) and Note 2, 
(7) (VX CU) (VY C-U) m*(XUY)>m'*X4m’Y. 


We may safely assume that the A, are disjoint. (If not, replace them by disjoint 
sets By, € M*, as in Corollary 1 of §1.) 
To prove (7), fix any X CU and Y C -U, and let 
Xp = XM Ax C Ak, 


Ag = —U, and Xo = Y, satisfying all assumptions of Lemma 4. Thus by (6), 
writing the first term separately, we have 


(8) m* (vu U Xx) =m*¥ +S > m*X,. 
k=1 k=1 
But 


UL) xe = J(xn 4) = x0 |] Ap = XN =X 
ss k=1 


II 
mn 
> 
II 
ma 


(as X CU). Also, by o-subadditivity, 
So m* Xp >m* JX: =m X. 
Therefore, (8) implies (7); so M* is a o-field. 
Moreover, m* is a-additive on M*, as follows from Lemma 4 by taking 
X, = Ap € M*, Ao = 90. 


Thus m* acts as a measure on M*. 

By Lemma 2, m* is complete; for if X is “null” (X C A and m*A = 0), then 
m*X =0; so X € M*, as required. 

Thus all is proved. 


We thus have a standard method for constructing measures: From a pre- 
measure 
pp: C > E* 
in S, we obtain the p-induced outer measure 


ms 2? =e (65): 
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this, in turn, induces a complete measure 
m: M* — E*. 
But we need more: We want m to be an extension of 1, i.e., 
m=ponc, 


with C C M* (meaning that all C-sets are m*-measurable). We now explore 
this question. 


Lemma 5. Let (5,C,w) and m* be as in Definition 3 of §5. Then for a set 
ACS to be m*-measurable, it suffices that 


(9) mX>m*(XNA)+m*(2#—A) for all X EC. 


Proof. Assume (9). We must show that (9) holds for any X CS, even not a 
C-set. 

This is trivial if m*X = oo. Thus assume m*X < co and fix any € > 0. 

By Note 3 in §5, X must have a basic covering {B,,} C C so that 


KG Be 
and 
(10) mm X+e> S > uBn > Sie Bas 
(Explain!) 


Now, as X C |) B,, we have 
XNAC(UJBaNA=|J(Ban A). 


Similarly, 
X-A=XN-AC| J(Bn—A). 
Hence, as m* is o-subadditive and monotone, we get 
4 MXN A) (X — A) Smt (Ban 4) + m* (Bn = A)) 
<> o[m*(B, 1A) + m"(Bp — A)]. 


But by assumption, (9) holds for any C-set, hence for each B,,. Thus 
m*(B, 0 A)+m*(B, — A) < m*B,, 
and (11) yields 


m*(X A) +m*(X — A) < So[m*(Brh NA) +m*(Bn — A)| < 5) m*Bn 
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Therefore, by (10), 
m*(X NA) +m*(X —A)<m*X +e. 


Making € — 0, we prove (10) for any X CS, so that A € M*, as required. 


Theorem 2. Let the premeasure 
pp: C— E* 


be o-additive on C, a semiring in S. Let m* be the p-induced outer measure, 


and 
m: M* > E* 
be the m*-induced measure. Then 
(i) CC M* and 
) =n =m onc, 
Thus m is a o-additive extension of 4 (called its Lebesgue extension) to M*. 


Proof. By Corollary 2 in 85, u is also o-subadditive on the semiring C. Thus 
by Theorem 2 in §5, 4 = m* on C. 

To prove that C C M*, we fix A € C and show that A satisfies (9), so that 
AEM, 

Thus take any X €C. AsC is a semiring, X M A € C and 


X-Az= U Ax, (disjoint) 
k=1 


for some sets A; € C. Hence 


m*(X 9 A) +m*(X — A) =m*(XN A) +m* |) Ae 
(12) 


<m*(X A) + 5 > m* Ay. 


As 
X =(XN A)U(X — A) =(XNA)UL J Ax (disjoint), 
the additivity of 4 and the equality 4 = m* on C yield 
m*X =m*(XMA)+ So m* Ag. 
k=1 
Hence by (12), 
m*X >m*(XMA)+m*(X — A); 


so by Lemma 5, A € M*, as required. 
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Also, by definition, m = m* on M*, hence on C. Thus 


* 
p=m =monc, 


as claimed. 


Note 3. In particular, Theorem 2 applies if 
pu: M — E* 


is a measure (so that C = M is even a o-ring). 
Thus any such ys can be extended to a complete measure m (its Lebesgue 
extension) on a o-field 
M* > M 
via the y-induced outer measure (call it u* this time), with 
i =m = pon M. 

Moreover, 

M* 2M 2 Me 
(see Note 2 in §3); so u* is M-regular and M*-regular (Theorem 3 of §5). 


Note 4. A reapplication of this process to m does not change m (Prob- 
lem 16). 


Problems on Measures and Outer Measures 


1. Show that formulas (1) and (2) are equivalent. 
[Hints: (i) Assume (1) and let X C A, Y C —A. 
As X in (1) is arbitrary, we may replace it by X UY. Simplifying, obtain (2) on 
noting that XN A=X,XN-A=0,YNA=0,and YN-A=Y. 
(ii) Assume (2). Take any X and substitute XA and X —A for X and Y in (2).] 


2. Given an outer measure space (S,M*,m*) and A C S, set 
AMM* ={AN xX |X eM*} 


(all sets of the form AN X with X € M*). 


Prove that AM M* is a o-field in A, and m* is o-additive on it. 
[Hint: Use Lemma 4, with X, = AN A, € AN M*,] 


3. Prove Lemmas 1 and 2, using formula (1). 
3’. Prove Corollary 1. 


4. Verify Examples (b), (c), and (d). Why is m an outer measure as well? 
[Hint: Use Corollary 2 in §5.] 


5. Fill in all details (induction, etc.) in the proofs of this section. 
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6. Verify that m* is an outer measure and describe M™* under each of the 
following conditions. 


(a) m*A=1if—9C ACS; m*O=0. 
(b) m*A=1ifGcAC S: m*S =2; m*)=—0. 


(c) m*A=0Oif A CS is countable; m* A = 1 otherwise (S is uncount- 


able). 
(d) S=WN (naturals); m*A = 1 if A is infinite; m*A = ~4, if A has 
n elements. 


7. Prove the following. 


(i) An outer measure m* is M*-regular (Definition 5 in §5) iff 


(VACS)(ABEM*) ACBandm*A=mB. 


B is called a measurable cover of A. 
[Hint: If 
m*A=inf{mxX | AC Xe M*}, 


then 


1 
(Vn) (AXn € M*) AC X,y and MX; < m*A+ — 
n 


Set B=()°, Xn] 
(ii) If m* is as in Definition 3 of §5, with C C M*, then m* is M*- 
regular. 


8. Show that if m* is M*-regular (Problem 7), it is left continuous. 
[Hints: Let {A,,}1; let Bp, be a measurable cover of An; set 


Verify that {Cn}?, Bn D Cn D An, and MCy = m*An. 
By the left continuity of m (Theorem 2 in §4), 


limm* Ayn = limmCn =m UJ Cn > m* UJ An. 
n=1 n=1 
Prove the reverse inequality as well.] 
9. Continuing Problems 6-8, verify the following. 
(i) In 6(a), with S = N, m* is M*-regular, but not right continuous. 
Hint: Take A, = {x E N|a>n}. 
(ii) In 6(b), with S = N, m* is neither M*-regular nor left continuous. 


(iii) In 6(d), m* is not M*-regular; yet it is left continuous. (Thus 
Problem 8 is not a necessary condition.) 
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10. 


11. 


12. 


In Problem 2, let n* be the restriction of m* to 24. Prove the following. 


(a) n* is an outer measure in A. 
(b) AM M* C N* = {n*-measurable sets}. 


(c) AM M* = N* if A € M*, or if m* is M*-regular (see Problem 7) 
and finite. 


(d) n* is N*-regular if m* is M*-regular. 
Show that if m* is M*-regular and finite, then A C S is m*- 
measurable iff 
mS = m*A+m*(—A). 
[Hint: Assume the latter. By Problem 7, 


(VX CS)(ABEM"*, BDX) m*X=mB; 


so 
m* A =m*(AN B)+m*(A-B). 


Similarly for —A. Deduce that 


m*(AN B) +m*(A— B)+m*(B-— A)+m*(—A-— B) = mS = mB +m(-B); 


hence 
m*X =mB>m*(BN A)+m*(B— A) > m*(XN A) +m*(X — A), 


soAeE M*|] 


Using Problem 15 in 85, prove that ifm* has the CP then each open set 
GCS is in M*. 
[Outline: Show that 


(VX CG) (VY C-G) m*(XUY)>m*X4+m'*Y, 
assuming m* X < oo. (Why?) Set 


Do ={x€ X | p(a,-G)>1} 


and 

Dy = Xx : < pl G)< k>1 

k x k + 17 PAL, k ? <i 
Prove that 
(i) X= || Dy 
k=0 

and 
(ii) P(Dg, Det2) > 9; 


so by Problem 15 in 85, 


> m* Dan =m" ) Din Sa La 


n=0 n=0 n=0 
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Similarly, 
foe) 
a m* Denti <m*X < ov. 
n=0 
Hence 
CoO 
S- m*Dn < ; 
n=0 
so 


im, 3 m* Dy = 0. 
k=n 


(Why?) Thus 


(Ve > 0) (An) S m* Dy <e. 
k=n 


Also, 
co n-1 co 
X= (| Dyes Dies \ Dg 
k=0 k=0 k=n 
so 
n-1 co n-1 
m*X <m* LU) De + > m* Dg <m* U Dry te. 
k=0 k=n k=0 
Adding m*Y on both sides, get 
n-1 
(iii) m*X +m*Y < m* 1 Dy t+m*yY +e. 
k=0 
Moreover, 
n—-1 
o(U D.,¥) > 0, 
k=0 
for Y C —G and 
1 
D;,, -—G) => ——. 
p(Dr, -G) = a 
Hence by the CP, 
n-1 n-1 
m*yY + oe m* Dy = m* (v U U) Dx) <m*(YUX). 
k=0 k=0 


(Why?) Combining with (iii), obtain 
m*X +m*Y <m*(XUY) +e. 
Now let ¢ > 01] 
=> 13. Show that ifm: M — E* is a measure, there is P € M, with 
mP = max{mxX |X € M}. 


[Hint: Let 
k =sup{mX | X € M} 
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=>*14. 


=>*15. 


in B*. As k > 0, there is a sequence rn 7k, rn < k. (If k = c, set rn = n; if 
k<o,ma=k— 1) By lub properties, 


(Vn) (AXn€M) tn <mXn <k, 
with {X,}f (Problem 9 in §3). Set 


Show that 
mP= lim mXy =k.] 


Given a measure m: M — E”, let 
M = {all sets of the form X UZ where X € M and Z is m-null}. 


Prove that M is a o-ring D M. 
[Hint: To prove that 
(VA,BEM) A-BEM, 
suppose first A € M and B is “null,” ie., BC U € M, mU =0. 
Show that 
A= pee 
with X =A-—UeE Mand Z=ANU—Bm-null (Z is shaded in Figure 31). 
Next, if A,B € M, let A= X UZ, 
B= X'U@Z', where X,X’ € M and 
Z,Z' are m-null. Hence 
A={B=(LU2)—8 
= (X — B)U(Z—-B) 
=(xX= Buz", 


A 


where 
Z'=Z-—B 


is m-null. Also, B = X’ U Z’ implies 


X—B=(X-—X')-Z'eEM, 
FIGURE 31 
by the first part of the proof. 


Deduce that 
A-B=(X-—B)UZ"EM 


(after checking closure under unions).| 
Continuing Problem 14, define m: M — E* by setting mA = mX 
whenever A = XU Z, with X € M and Z m-null. (Show that mA does 
not depend on the particular representation of A as X U Z.) 

Prove the following. 


(i) 7 is a complete measure (called the completion of m), with m =m 


on M. 
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(ii) ™ is the least complete extension of m; that is, ifn: NM — E* is 
another complete measure, with M C N and n=m on M, then 


MCN andn=™m on M. 
(iii) m = ™ iff m is complete. 


Show that if m: M* — E* is induced by an M*-regular outer measure 
u*, then m equals its Lebesgue extension m’ and completion ™ (see 
Problem 15). 


[Hint: By Definition 3 in §5, m induces an outer measure m*. By Theorem 3 in §5, 
m*A=inf{mx |ACXEM*}=p"A 
(for p* is M*-regular). 
As m* = p*, we get m’ =m. Also, m = ™, by Problem 15(iii).] 
Prove that if a measure uw: M — E* is o-finite (Definition 4 in §5), with 
S eM, then its Lebesgue extension m: M* — E* equals its completion 
ft (see Problem 15). 


(Outline: It suffices to prove M* C M. (Why?) 
To start with, let AE M*, mA < co. By Problem 12 in §5, 


(ABEM) AC Band m*A=mA=mMB < o~; 


so 
m(B— A)=mB-—mA=0. 


Also, 


(AHEM) B-ACH and pH = m(B-—A)=0. 

Thus B — A is p-null; so B— A € M. (Why?) Deduce that 
A=B-(B-A)EM. 

Thus M contains any A € M* with mA < oo. Use the o-finiteness of ps to show 


(Va € M*) (A{An} CM") mAn < oo and X =|J4An eM] 


n 


87. Topologies. Borel Sets. Borel Measures 


I. Our theory of set families leads quite naturally to a generalization of metric 
spaces. As we know, in any such space (S,p), there is a family G of open sets, 
and a family F of all closed sets. In Chapter 3, 812, we derived the following 
two properties. 


(i) G is closed under any (even uncountable) unions and under finite inter- 


sections (Chapter 3, §12, Theorem 2). Moreover, 


OE€Gand SEG. 
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(ii) F has these properties, with “unions” and “intersections” interchanged 
(Chapter 3, §12, Theorem 3). Moreover, by definition, 


AeéFf iff -AegG. 


Now, quite often, it is not so important to have distances (i.e., a metric) 
defined in S, but rather to single out two set families, G and F, with proper- 
ties (i) and (ii), in a suitable manner. For examples, see Problems 1 to 4 below. 
Once G and F are given, one does not need a metric to define such notions as 
continuity, limits, etc. (See Problems 2 and 3.) This leads us to the following 
definition. 


Definition 1. 
A topology for a set S is any set family G C 2°, with properties (i). 
The pair (S,G) then is called a topological space. If confusion is un- 
likely, we simply write S for (S,G). 
G-sets are called open sets; their complements form the family F 


(called cotopology) of all closed sets in S; F satisfies (ii) (the proof is 
as in Theorem 3 of Chapter 3, §12). 


Any metric space may be treated as a topological one (with G defined as in 
Chapter 3, §12), but the converse is not true. Thus (S,G) is more general. 
Note 1. By Problem 15 in Chapter 4, §2, a map 


felSo) 17") 


is continuous iff f—1[B] is open in S whenever B is open in T. 

We adopt this as a definition, for topological spaces S,T. 

Many other notions (neighborhoods, limits, etc.) carry over from metric 
spaces by simply treating G,, as “an open set containing p.” (See Problem 3.) 


Note 2. By (i), G is surely closed under countable unions. Thus by Note 2 
in 83, 


G = Gow 
Also, G = Gg and 
Fs == Fa 
but not 
G=GsorF =F, 
in general. 


G and F need not be rings or o-rings (closure fails for differences). But by 
Theorem 2 in §3, G and F can be “embedded” in a smallest o-ring. We name 
it in the following definition. 
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Definition 2. 


The o-ring B generated by a topology G in S is called the Borel field in 
S. (It is a o-field, as S€G CB.) 

Equivalently, B is the least o-ring D F. (Why?) 

B-sets are called Borel sets in (S,G). 


As B is closed under countable unions and intersections, we have not only 
BDGandb DF, 
but also 


B 2 Gs, B 2 eee B 2 Osa li-e., (Gael; B 3 Fae; etc. 


Note that 
Gis = Gy, Foe = Fo ete: (Why!) 


II. Special notions apply to measures in metric and topological spaces. 
Definition 3. 
A measure m: M — E* in (S,G) is called topological iff G C M, ie., all 


open sets are measurable; m is a Borel measure iff M = B. 


Note 3. IfG CM (ao-ring), then also B C M since B is, by definition, 
the least o-ring D G. 

Thus m is topological iff B C M (hence surely F CM, Gs CM, Fg CM, 
etc.). 


It also follows that any topological measure can be restricted to B to obtain 
a Borel measure, called its Borel restriction. 


Definition 4. 


A measure m: M — E* in (S,G) is called regular iff it is regular with 
respect to MMG, the measurable open sets; i.e., 


(VAEM) mA=inf{mxX | AC X EMNG}. 
If m is topological (G C M), this simplifies to 
(1) mA = inf{mxX | AC X € G}, 
i.e., m is G-regular (Definition 5 in §5). 


Definition 5. 


A measure m is strongly regular iff for any A € M and « > 0, there is an 
open set G € M and a closed set F € M such that 


(2) FCACG, with m(A—- F) <e and m(G— A) <é; 
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thus A can be “approximated” by open supersets and closed subsets, both 
measurable. As is easily seen, this «mplies regularity. 
A kind of converse is given by the following theorem. 


Theorem 1. [f a measure m: M — E* in (S,G) is regular and o-finite (see 
Definition 4 in §5), with S € M, then m is also strongly regular. 


Proof. Fix ¢ > 0 and let mA < o. 
By regularity, 
mA =inf{mx |AC Xe MnG}; 
so there is a set X € MG (measurable and open), with 
AC X and mX <mA+te. 
Then 
m(X — A) =mX —mA <e, 


and X is the open set G required in (2). 
If, however, mA = oo, use o-finiteness to obtain 


ee 
k=1 


for some sets X, € M, mXx < 00; so 


A=|J(An X). 
k 


Put 
A, =ANX;, € M. 


(Why?) Then 
A=|JA:, 
k 
and 
mA, <mX;, < . 


Now, by what was proved above, for each A, there is an open measurable 
Gy D> Ag, with 


Set 
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Then GE MNG and G D A. Moreover, 
G-A=|JG,—-(J) 4x ©U(Ge - Ax). 
k k k 


(Verify!) Thus by o-subadditivity, 


— A) < So m(Gk - Ak) < SSigere =e, 
k 
as required. 
To find also the closed set F’, consider 
-A=S-AeM. 
As shown above, there is an open measurable set G’ D —A, with 
e > m(G’ — (—A)) = m(G’N A) = m(A — (-G’)). 


Then 
F=-G'CA 


is the desired closed set, with m(A — F’) <« 


Theorem 2. [fm: M — E* is a strongly regular measure in (S,G), then for 
any A € M, there are measurable sets H € F, and K € Gs such that 


(3) HCACK andm(A- A) =0=Mm(K — A); 
hence 


mA=mH =mK. 


Proof. Let A € M. By strong regularity, given ¢, = 1/n, one finds measur- 
able sets 
Gye 9 and F767 5) = LQ, 


such that 
iy Ae Gy, 
and 
1 if 
(4) m(A— Fn) < — and m(Gn —-A)< ra Sg? aes 
Let a es 
H= J Fn and K = () Cus 
n=1 n=1 


Then H,K eM, HE F,, K € Gs, and 
HCACK. 
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Also, F, C H and G, DK. 


Hence 
A-HCA-—F, and K-—ACG, — A; 
so by (4), 
m(A—H)<——0and m(K ~ A) <> 30. 
Finally, 


mA=m(A-—H)+mH =mH, 


and similarly mA = mK. 


Thus all is proved. 


Problems on Topologies, Borel Sets, and Regular Measures 
1. Show that G is a topology in S' (in (a)-(c), describe B also), given 
(a) G = 2°; 
(b) G = {0, S}; 
(c) G = {@ and all sets in S, containing a fixed point p}; or 
) 


(d) S = E*; G consists of all possible unions of sets of the form (a, b), 
(a, oo], and [—o00, b), with a,b € E?. 


G 
G 


2. (S,p) is called a pseudometric space (and p is a pseudometric) iff the 
metric laws (i)—(iii) of Chapter 3, §11 hold, but (i’) is weakened to 
pe.2)=0 


(so that p(x, y) may be 0 even if « # y). 


(a) Define “globes,” “interiors,” and “open sets” (i.e., G) as in Chap- 
ter 3, §12; then show that G is a topology for S. 


(b) Let S = E? and 
p(Z, 9) = |z1 - yal, 
where = (21, %2) and y = (y1, y2). Show that p is a pseudometric 


but not a metric (the Hausdorff properly fails!). 


3. Define “neighborhood,” “interior,” “cluster point,” “closure,” and 
“function limit” for topological spaces. Specify some notions (e.g., “di- 
ameter,” “uniform continuity”) that do not carry over (they involve 
distances). 


4. In a topological space (.5,G), define 
Gr=G. gi =Gz5, G? = Goo, 2s. 
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and 

PRES of ao kv gga Se See. 
(Give an inductive definition.) Then prove by induction that 
a) OC BF CB 
beg?" OF ee ee 
(c) WX CS) Xe F" iff —X eg", 
d) 
) 


(e 


( 
( 
(d) VWX,Y €F") XNY €F", XUY € F"; same for G”; 
VX EG") (VY €F") X-YeG" and Y—-X EF". 
(Hint! X -Y =XnN-Y]] 

5. For metric and pseudometric spaces (see Problem 2) prove that 
Fe CO and OMe ee 


(cf. Problem 4). 
[Hint for F C Gs: Let F € F. Set 


Be ly. 
oo Yar) 


so 
(Vvn) FCGneG. 


Hence 


FC )Gn € G5. 


n 


Also, 
(\Gn=F=F 


n 


by Theorem 3 in Chapter 3, §16. Hence deduce that 
(WF CF) FEGs, 
so F C Gs; hence G C Fe by Problem 4(c). Now use induction.] 
6. If m is as in Definition 5, then prove the following. 
(i) m is regular. 
(ii) (VA EM) mA=sup{mxX | AD XE MNF}. 
(iii) The latter implies strong regularity ifm <oo and Se M. 
7. Let 4: B — E* be a Borel measure in a metric space (S,/). Set 
(VACS) n*A=inf{wxX | AC X €G}. 
Prove that 
(i) n* is an outer measure in S; 


(it) a" = ong; 
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(iii) the n*-induced measure, n: V* — E*, is topological (so B C N*); 
(iv) n> pu on B; 

(v) WACS) (AH €Gs) AC FH and pH = n*A. 
[Hints: (iii) Using Problem 15 in §5 and Problem 12 in §6, let 


(X,Y) >e>0, U= U G-(5¢), V= U (52): 
x y 


Verify that U,. VEG,UDX,VDY,UNV=%. 
By the definition of n*, 


(A4GEG) GD XUY and n*G <n*(XUY) +e; 
also, X CGNU and Y CGN V. Thus by (ii), 
n*X <p(GNU) and n*Y < wW(GNV). 
Hence 
n*X+n*VY < w(GNU)+hu(GNV) = w((GNU)U(GNV)) < uG = n*G < n*(XUY)+e. 


Let ¢ > 0 to get the CP: n*X+n*Y <n*(X UY). 
(iv) We have (VA € B) 


nA=n*A=inf{ux | AC X €G}> inf{ux | AC xX € BY =A. 


(Why?) 
(v) Use the hint to Problem 11 in §5.] 


8. From Problem 7 with m = 1, prove that if 
ACGE, 


with mG < coo and A€ B, then mA = nA. 
[Hint: A, G, and (G— A) € B. By Problem 7(iii), B C N* and n is additive on B; 
so by Problem 7(ii) (iv), 


nA =nG—n(G— A) < mG@—m(G— A) =mA< nA. 
Thus mA = nA. Explain all!] 


9. Let m,n, and n* be as in Problems 7 and 8. Suppose 


S=| Cr 
n=1 
with G, € G and mG, < 00 (this is called o°-finiteness). 


Prove that 
(i) m =n on B, and 


(ii) m and n are strongly regular. 


168 Chapter 7. Volume and Measure 


[Hints: Fix A € B. Show that 
A= LU) An (disjoint) 


for some Borel sets An C Gp (use Corollary 1 in §1). By Problem 8, mAn = nAn 
since 


An © Gn €G 


and mGn < co. Now use o-additivity to find mA = nA. 
(ii) Use G-regularity, part (i), and Theorem 1.] 


10. Continuing Problems 8 and 9, show that n is the Lebesgue extension of 
m (see Theorem 2 in §6 and Note 3 in §6). 
Thus every o°-finite Borel measure m in (S,p) and its Lebesgue ex- 
tension are strongly regular. 
[Hint: m induces an outer measure m*, with m* =m on B. It suffices to show that 
m* = n* on 25. (Why?) 
So let A C S. By Problem 7(v), 


(4H €B) ACH andn*A=mH =m*H. 


Also, 
(Ak €B) ACK andm*A=mkK 


(Problem 12 in §5). Deduce that 
n*A<n(HN K)=m(HNK)<mH=n*A 


and 
n*A=m(Hn K)=m*A\] 


88. Lebesgue Measure 


We shall now consider the most important example of a measure in E”, due to 
Lebesgue. This measure generalizes the notion of volume and assigns “volumes” 
to a large set family, the “Lebesgue measurable” sets, so that “volume” becomes 
a complete topological measure. For “bodies” in E*, this measure agrees with 
our intuitive idea of “volume.” 

We start with the volume function v:C — E! (“Lebesgue premeasure” ) 
on the semiring C of all intervals in E” (§1). As we saw in §§5 and 6, this 
premeasure induces an outer measure m* on all subsets of £”; and m*, in 
turn, induces a measure m on the o-field M* of m*-measurable sets. These 
sets are, by definition, the Lebesgue-measurable (briefly L-measurable) sets; m* 
and m so defined are the (n-dimensional) Lebesgue outer measure and Lebesgue 
measure. 
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Theorem 1. Lebesgue premeasure v is o-additive on C, the intervals in E”. 
Hence the latter are Lebesgue measurable (C C M*), and the volume of each 
interval equals its Lebesgue measure: 


v=m* =m onc. 


This follows by Corollary 1 in §2 and Theorem 2 of 86. 


Note 1. As M* is ac-field (§6), it is closed under countable unions, count- 
able intersections, and differences. Thus 


CCM’ implies Cz GM: 
i.e., any countable union of intervals is L-measurable. Also, E” € M*. 
Corollary 1. Any countable set AC E” is L-measurable, with mA = 0. 
The proof is as in Corollary 6 of §2. 
Corollary 2. The Lebesgue measure of E” is oo. 
Prove as in Corollary 5 of §2. 


Examples. 
(a) Let 
R = {rationals in E'}. 


Then R is countable (Corollary 3 of Chapter 1, 89); so mR = 0 by Corol- 
lary 1. Similarly for R” (rational points in E”). 


(b) The measure of an interval with endpoints a,b in E! is its length, b — a. 
Let 
R, = {all rationals in [a, b]}; 


somR, = 0. As [a,b] and R, are in M* (a o-field), so is 
[a,b] — Ro, 
the irrationals in [a,b]. By Lemma 1 in §4, if b > a, then 
m/((a, 6] — Ro) = m([a, b]) — mR, = m([a, b]) =b-a>0=mMRg. 
This shows again that the irrationals form a “larger” set than the rationals 
(cf. Theorem 3 of Chapter 1, 89). 

(c) There are uncountable sets of measure zero (see Problems 8 and 10 below). 
Theorem 2. Lebesgue measure in E” is complete, topological, and totally o- 
finite. That is, 

(i) all null sets (subsets of sets of measure zero) are L-measurable; 


(ii) so are all open sets (M* DG), hence all Borel sets (M* D B); in partic- 
ular, M> 2 FM” 2 Gg MD Fay." D Fxg; 6teg 
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(iii) each A € M* is a countable union of disjoint sets of finite measure. 


Proof. (i) This follows by Theorem 1 in 86. 

(ii) By Lemma 2 in §2, each open set is in C,, hence in M* (Note 1). Thus 
M* 2G. But by definition, the Borel field B is the least o-ring D G. Hence 
MP > B*. 


(iii) As E” is open, it is a countable union of disjoint half-open intervals, 
EB” = |_) Ax (disjoint), 
k=1 
with mA, < co (Lemma 2 in §2). Hence 
(VACE") AC\|JAzp; 
so 
A= L(A M Ax) (disjoint). 
k 
If, further, A € M*, then AN Ay € M*, and 
m(ANM Ax) < MAR < co. (Why?) 


Note 2. More generally, a o-finite set A € M in a measure space (S,M, 1) 
is a countable union of disjoint sets of finite measure (Corollary 1 of §1). 


Note 3. Not all L-measurable sets are Borel sets. On the other hand, not 
all sets in E” are L-measurable (see Problems 6 and 9 below.) 


Theorem 3. 
(a) Lebesgue outer measure m* in E” is G-regular; that is, 
(1) (VAC E”") m*A=inf{mx | AC X EG} 
(G = open sets in E”). 
(b) Lebesgue measure m is strongly regular (Definition 5 and Theorems 1 


and 2, all in §7). 


Proof. By definition, m*A is the glb of all basic covering values of A. Thus 
given € > 0, there is a basic covering {B,} C C of nonempty sets B;, such that 


lt 
(2) AC|)B and TA oe ne 
(Why? What if m*A = 00?) 
Now, by Lemma 1 in 82, fix for each By, an open interval C, > B, such that 


uC, — < uBy,. 


= 
Dk+1 
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Then (2) yields 
2 ey oe ewe eee 
my +562 0 (vCe— ser) = 0k — 503 
k k 


so by o-subadditivity, 
(3) ml JCe < So mC, = Souk <m*Ate. 
k k k 


Let 
X =| Cp. 
k 


Then X is open (as the Ci are). Also, A C X, and by (3), 
mxX <m*Ate. 


Thus, indeed, m*A is the glb of all mX, AC X € G, proving (a). 

In particular, if A € M*, (1) shows that m is regular (for m*A = mA). 
Also, by Theorem 2, m is o-finite, and E” € M*; so (b) follows by Theorem 1 
in 87. 


Definition. 
Given A C E” and p € E”, let p+ A or A+ p denote the set of all points 
of the form 
+p, ZEA. 
We call A+ p the translate of A by p. 


Theorem 4. Lebesgue outer measure m* and Lebesgue measure m in E” are 
translation invariant. That is, 


(i) WAC E”) (Vpe E”) m*A=m*(A+p); 
(ii) af A is L-measurable, so is A+ p, andmA=m(A+>p). 
See also Problem 7 in §10. 
Proof. (i) If A is an interval with endpoints @ and b, then A+ is the interval 
with endpoints @+ p and b+ p. (Verify!) 
Hence the edge lengths of A and A+ 7p are the same, 
£, = by — ag = (bp +0n) — (Qn + pe), &=1,2,...,0 
Thus 
mA=vA= || & =m(A+5); 
k=1 


so the theorem holds for intervals. 
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In the general case, m*A is the glb of all basic covering values of A. But a 
basic covering consists of intervals that, when translated by p, cover A+ p and 
retain the same volumes, as was shown above. 

Hence any covering value for A is also one for A+ p, and conversely (since 
A, in turn, is a translate of A+ p by —p). 

Thus the basic covering values of A and of A+ are the same, with one and 
the same glb. Hence 

m*A=m*(A+)p), 


as claimed. 
(ii) Now let A € M*. We must show that 
A+peM*, 
iLe., that 


(VX CA+p) (VY C-(At+p)) m*X4+m*Y =m (XUY). 


Thus fix X C A+pand Y C—(A+ )). 
As is easily seen, X — p C A and Y —p C —A (translate all by —p). Since 
Aée M*, we get 


m*(X — p) +m*(Y —p) = m*((X UY) — p). 
(Why?) But by (i), m*X = m*(X — p), m*Y = m*(Y — p), and 


m*(X UY) =m*((X UY) —9). 


Hence 
mX+mY =m*(X UY), 


and so A+ p€ M*. 
Now, as m* =m on M*, (i) yields mA = m(A +p), proving (ii) also. 


Problems on Lebesgue Measure 
1. Fill in all details in the proof of Theorems 3 and 4. 
1’. Prove Note 2. 
2. From Theorem 3 deduce that 


(VAC E”) (ABEGs) ACBand m*A=mB. 


[Hint: See the hint to Problem 7 in §5.] 
3. Review Problem 3 in 85. 


4. Consider all translates 
R+p (pe E') 
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of 
R = {rationals in E'}. 


Prove the following. 
(i) Any two such translates are either disjoint or identical. 
(ii) Each R+ p contains at least one element of [0, 1]. 
[Hint for (ii): Fix a rational y € (—p,1—p),so0<y+p<1. Theny+peR+p, 
and y+ p € (0, 1].] 
5. Continuing Problem 4, choose one element q € [0,1] from each R + p. 
Let Q be the set of all g so chosen. 
Call a translate of Q, Q+r, “good” iff r € R and |r| < 1. Let U be 
the union of all “good” translates of Q. 
Prove the following. 


a) There are only countably many “good” Q +r. 
b) All of them lie in [—1, 2]. 
c 


(c) Any two of them are either disjoint or identical. 


( 
( 
(d) [0,1] CU C [-1, 2]; hence 1 < m*U < 3. 
[Hint for (c): Suppose 

ye (Q+ryn(Qt+r’). 


Then 
y=qtr=qd+tr’ (4¢ €Q, rr’ € R); 


so g=q'+(r’—r), with (r’—r) ER. 
Thus g€ R+q‘ and qd =0+q' € R+q’. Deduce that q = q’ and r =r’; hence 
Q+r=Q+r'] 
6. Show that @ in Problem 5 is not L-measurable. 
[Hint: Otherwise, by Theorem 4, each @ +r is L-measurable, with m(Q +r) = mQ. 
By 5(a)(c), U is a countable disjoint union of “good” translates. 
Deduce that mU = 0 if mQ = 0, or mU = ov, contrary to 5(d).] 


7. Show that if f: S — T is continuous, then f~1[X] is a Borel set in $ 
whenever X € B in T. 
[Hint: Using Note 1 in §7, show that 


R={X CT | f-1[X] € Bins} 
is a o-ring in T’. As B is the least o-ring D G, R D B (the Borel field in T’.] 


8. Prove that every degenerate interval in E” has Lebesgue measure 0, 
even if it is uncountable. Give an example in E?. Prove uncountability. 
(Hint: Take @ = (0,0), b = (0,1). Define f: E! — E? by f(x) = (0,2). Show that f 
is one-to-one and that [@, b] is the f-image of [0,1]. Use Problem 2 of Chapter 1, §9.] 
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10. 


11. 


12. 


*13. 


14. 


15. 
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Show that not all L-measurable sets are Borel sets in E”. 

[Hint for E?: With [a,b] and f as in Problem 8, show that f is continuous (use the 
sequential criterion). As m[a@, b] = 0, all subsets of [a,b] are in M* (Theorem 2(i)), 
hence in B if we assume M* = B. But then by Problem 7, the same would apply to 
subsets of [0,1], contrary to Problem 6. 


Give a similar proof for E” (n > 1). 
Note: In E!, too, B 4 M*, but a different proof is necessary. We omit. it.] 


Show that Cantor’s set P (Problem 17 in Chapter 3, §14) has Lebesgue 
measure zero, even though it is uncountable. 


[Outline: Let 
U = [0,1] — P; 


so U is the union of open intervals removed from [0,1]. Show that 


1 2\n 
rah EQ a 
ue 2d 3 
and use Lemma 1 in §4.] 


Let w: B — E* be the Borel restriction of Lebesgue measure m in E” 
(§7). Prove that 


(i) in incomplete; 


(ii) m is the Lebesgue extension (*and completion, as in Problem 15 
of 86) of yu. 


[Hints: (i) By Problem 9, some ji-null sets are not in B. (ii) See the proof (end) of 
Theorem 2 in 89 (the nezt section).] 


Prove the following. 
(i) All intervals in E” are Borel sets. 


(ii) The o-ring generated by any one of the families C or C’ in 
Problem 3 of §5 coincides with the Borel field in E”. 


[Hints: (i) Any interval arises from a closed one by dropping some “faces” (degenerate 
closed intervals). (ii) Use Lemma 2 from §2 and Problem 7 of §3.] 


Show that if a measure m’: M’ — E* in E” agrees on intervals with 
Lebesgue measure m: M* — E*, then the following are true. 


(i) m’ =m on B, the Borel field in E”. 
(ii) If m’ is also complete, then m’ = m on M*. 
[Hint: (i) Use Problem 13 of §5 and Problem 12 above.] 


Show that globes of equal radius have the same Lebesgue measure. 
[Hint: Use Theorem 4.] 


Let f: BE” — E”, with 


fie) jer (0 <= 06), 
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Prove the following. 
(i) (VAC E”) m*f[A] = c"m*A (m* = Lebesgue outer measure). 
(ii) A € M* iff f[A] © M*. 


(Hint: If, say, A = (@,b], then f[A] = (c@,cb]. (Why?) Proceed as in Theorem 4, 
using f—! also.] 


16. From Problems 14 and 15 show that 
(i) mGg(er) = ce” -mG;z(r); 
(ii) mGp(r) = mGp(r); 
(iii) mG5(r) = a- ml, where I is the cube inscribed in G(r) and 
1 n 
a=(Svn) -mGp(1). 
[Hints: (i) f[Go(r)] = Ga(er). (ii) Prove that 
mGp < mG5 < c"mG5 
ife > 1. Let c— 1.] 


17. Given a < bin E', let {r,,} be the sequence of all rationals in A = {a, b]. 


Set (Vn) 

b-—a 

On = gnt+1 
and i i 
Ga = (Gin, On) = (a, b) M (rm — gem Tm + son). 
Let so 
P=A-\|JG,. 
n=1 


Prove the following. 
(i) Doma bn = 5 (b— a) = 5mA. 
(ii) P is closed; P° = 0, yet mP > 0. 
(iii) The G,, can be made disjoint (see Problem 3 in §2), with mP still 


> 0. 
(iv) Construct such a P C A (P = P, P° = 9) of prescribed measure 
mr =e ou. 


18. Find an open set GC E!, with mG < mG < ow. 
[Hint: G = UP2_, Gn with Gn as in Problem 17.] 


*19. If A C E” is open and conver, then mA = mA. 
[Hint: Let first 0 € A. Argue as in Problem 16.] 
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Let 
a: E! > FE! 


be a nondecreasing function (at). Consider the Lebesgue-—Stieltjes set function 
Sq (Example (d) in §4). 
As we noted in Problem 7 of §4, s, > 0 when at; for then 


Sq(a,b) = a(b—) — a(a+) > 0. 


Similarly for other intervals. Also, @ € C and s,( = 0 by definition. 

Thus s, is a premeasure on C (finite intervals in E'), called the a-induced 
Lebesgue—Stieltjes (LS) premeasure in E?. 

The outer measure m* induced by sq (85) is called the a-induced LS outer 
measure; its restriction to the family M* of m*-measurable (or LS-measurable) 
sets is the a-induced LS measure on E', denoted mq. 

Recall that, by our definitions, premeasures, outer measures, and measures 
are all nonnegative. 


Note 1. No generality is lost by assuming that a is right continuous (if not, 
replace it by the right-continuous function 37, with 6(x#) = a(#+)). Similarly, 
one achieves left continuity by setting 3(x) = a(#—). 


Note 2. If a is right continuous, one often restricts sq to the family C* of 
all half-open intervals (for motivation, see Problem 7(iv) in §4). This does not 
affect m* or mq (Problem 3’ in §5), and simplifies the proof of additivity 


Sq(a, b] + 5.,(b, c] = a(b) — a(a) + a(c) — a(b) = a(c) — a(a) = sQ(a, cl. 


Recall that both C and C* are semirings (Note 1 in §1). 


Theorem 1. The LS premeasure sq is o-additive on the semiring C of all 
finite intervals in E'. 

Hence (by Theorem 2 in §6) all such intervals are LS-measurable (C C M*), 
and 


MaA = 8,A 


for any such interval A. 


Proof. As is easily seen, sq is additive (Problem 7 of §4). 
It also satisfies Lemma 1 of §1 and Lemma 1 in §2 (Problem 7(v) in 84). 
The proof of g-additivity is then quite analogous to that of Theorem 1 of §2; 
we omit its repetition. 


The rest is immediate by Theorem 2 of 86. 
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Similarly, the proofs of Theorems 2 and 3 (but not 4) of §8 carry over to 
LS measures. Thus LS measures are complete, topological, totally o-finite and 
strongly regular. 

As in 88, it follows that singletons and countable sets are measurable, but 
their LS measure need not be 0 (Problem 8(iii) in §4). 

Also, E! € M*, but m.E! may be finite (Problem 8(ii)(ii’) in §4). 

Since the proofs are the same as in 88, we omit them. 

Note, however, the following facts. 

(i) For singletons, ma{p} = 0 iff a is continuous at p (Problem 7(ii) in §4). 

(ii) Hence 
Ma|a, b] = m_(a, b] = m,[a, b) = ma(a, b) = a(b) — a(a) 
iff @ is continuous at a and b (Problem 7(iv) in §4). 
(iii) LS measures need not be translation invariant (Problem 8(i) of §4). 
(iv) If a(x) =z on E', then m* = m* (= Lebesgue outer measure in E'). 
Thus Lebesgue measure is a special case of LS measure. 

The latter is a kind of “weighted length.” Imagine that mass is distributed 

along the line, with a(a) equal to the mass of 
(Os; z| : 


For simplicity, assume that a is right-continuous (cf. Notes 1 and 2). Then the 
mass of (a, bj is 

a(b) — a(a), 
and p is a “point mass” iff 

Ma{p} > 0. 


Our next theorem shows that LS measures practically exhaust all topological 
measures in E! of any importance. We shall use Notes 1 and 2 above. 


*Theorem 2. Let m: M — E* be a topological measure in E', finite on C* 
(half-open intervals). Then there is an LS measure mq such that 


Ne =m. 
on the Borel field B in E'. 
If m is also complete, then my =m on all of M*. 
Proof. Define a as follows: 
m(0,7| ife> 0, 
a(x) = 
—m(z,0] ifx <0. 


Clearly, at on E'. Also, the right continuity of m (Theorem 2 of §4) implies 
that of a. (Verify!) 
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Thus a induces an LS measure m,, with 
Ma(a, b] = sa(a, b] = a(b) — a(a) 
(Problem 7(iv) in §4). We claim that m, =m on B. 
First, consider any (a, b] € C*. If0 <a< 6, then 
m(a, b] = m(0, b] — m(0, a] = a(b) — a(a) = ma(a, D]. 
Similarly in the cases a<0< banda<b<0. Thus 
Ma =m (finite) on C*. 


By Problem 13 in 85, 
Ma =m on B, 


the o-ring generated by C* (Problem 12 of 88). Thus m and ma have the same 
restriction to B (call it py). 

Now, by Note 3 in 86, w induces an outer measure u*. 

As BD C%, both y* and m* are B-regular, by Theorem 3 in 85. Thus 


(VAC E') m*(A)=inf{ux | AC X € By =p*A, 


ie., m% = w*, and so mz, is the restriction of both m*, and yu* to measurable 
sets. Hence mq is the Lebesgue extension of wu, by definition. 

By Problem 17 in $6, ma = 7 is the “least” complete extension of yz. Thus 
if m is complete, it is an extension of ma; som = M~_ on M3, as claimed. 


Problems on Lebesgue—Stieltjes Measures 
1. Do Problems 7 and 8 in §4 and Problem 3’ in §5, if not done before. 


2. Prove in detail Theorems 1 to 3 in 88 for LS measures and outer mea- 
sures. 


3. Do Problem 2 in §8 for LS-outer measures in E!. 


4. Prove that f: E' — (S,:) is right (left) continuous at p iff 
Jim f(an) = f(p) a8 tn \p (@n 7 P): 


[Hint: Modify the proof of Theorem 1 in Chapter 4, §2.] 


5. Fill in all proof details in Theorem 2. 
[Hint: Use Problem 4.] 


6. In Problem 8(iv) of §4, describe m* and M%. 
7. Show that if a = c (constant) on an open interval I C E! then 
(VACT) mi(A) =0. 


Disprove it for nonopen intervals I (give a counterexample). 
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8. 


*9. 


Let m’: M — E* be a topological, translation-invariant measure in E', 
with m’(0, 1] = c < oc. Prove the following. 


(i) m’ = cm on the Borel field B. (Here m: M* — E* is Lebesgue 
measure in E'.) 


*(ii) If m’ is also complete, then m!’ = cm on M*. 
(iii) If 0 < c < oo, some set Q C [0,1] is not m’-measurable. 
*(iv) If M’ = B, then cm is the completion of m’ (Problem 15 in §6). 
[Outline: (i) By additivity and translation invariance, 
m'(0,r] = cm(0,7] 
for rational 


n 
=—, nkeEN 
Tr a mr 


1 
(first take r =n, then r= 7, then r= 7). 


By right continuity (Theorem 2 in §4), prove it for real r > 0 (take rationals 
ry \N 1). 
By translation, m’ = cm on half-open intervals. Proceed as in Problem 13 of §8. 


(iii) See Problems 4 to 6 in §8. Note that, by Theorem 2, one may assume 
m! = Mq (a translation-invariant LS measure). As ma = cm on half-open intervals, 
Lemma 2 in §2 yields ma = cm on G (open sets). Use G-regularity to prove m*, = 
cm* and Mé* = M*.] 

(LS measures in £”.) Let 
C* = {half-open intervals in E”}. 
For any map G: E” — E! and any (a, }] € C*, set 
AgG(0,.6) = Ge ij.00 op ds Dee Piece phy) 
= 6G ese pe a Peis eo l<k<n. 
Given a: E” > E!, set 
Sa(G, 6] = Ar(Aa(--- (Ana(@, 6) ---))- 
For example, in E?, 
Sq(a, b] = a(bi, be) — a(b1, a2) — [a(ai, be) — a(a1, a2)). 


Show that s, is additive on C*. Check that the order in which the A; 
are applied is immaterial. Set up a formula for sy in E°. 


[Hint: First take two disjoint intervals 
(a, q] U (p, 6] = (, }, 


as in Figure 2 in Chapter 3, §7. Then use induction, as in Problem 9 of Chapter 3, §7.] 
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*10. If s, in Problem 9 is nonnegative, and a is right continuous in each 
variable x, separately, we call a a distribution function, and sq is called 
the a-induced LS premeasure in E”; the LS outer measure m* and 
measure 

Ma: Mi - E* 


in E” (obtained from sq as shown in §85 and 6) are said to be induced 
by a. 
For sg, m3, and mq so defined, redo Problems 1-3 above. 


*810. Vitali Coverings 


Lebesgue measure m leads to an interesting analogue of the Heine—Borel the- 
orem. Below, m* is Lebesgue outer measure in #”. We start with some 
definitions. 


Definition 1. 


A sequence {J,} of sets in a metric space (5,9) converges to a point p 


(Ii, — p) iff 
pe () Tk 
-=1 


and 
jim dl, = 0, 


where dJ;, = diameter of Jj. 


Definition 2. 


A family K of nonempty sets in (S,p) is a Vitali covering (V-covering) 
of a set A C (5, p) iff for each p € A there is a sequence {I,} C K, with 
Ty =D. 

We then also say that K covers A in the Vitali sense (V-sense). 


Theorem 1 (Vitali). If a set K of nondegenerate cubes (or globes) in E” 
covers A in the V-sense, then 


m*(A—(JIk) =0 
k 


for some disjoint sequence {Ij,} CK. 


Proof. We give the proof for cubes (it is similar for globes). 


First, suppose A C I° for some open cube J°. Then A is also covered in the 
V-sense by the subfamily K° C K of those cubes that lie in I°. (Why?) We also 
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assume that A ¢ UJ; for any disjoint finite sequence {I;} C K (otherwise, all 
is trivial). Finally , we assume that all cubes in K are closed; for other kinds 
of cubes, the theorem then easily follows (see Problem 3 below). 


We claim that 


h 
(1) (V disjoint cubes I1,... ,In €K°) (ALEK?) IN U R=: 
j=l 


Indeed, as 
h 
A¢\ 4, 
j=l 
there is some 
h 
peA- U rf 
j=l 
By assumption, all I; are closed; so 
h 
= U I; 
j=l 


is open. Hence there is a globe 
h 
Gp(6) C- J G. 
j=l 
As K° is a V-covering, it contains a sequence I; — p, dl; — 0; so there is 


IT=T1;€K° with p € I and dl < 6. Therefore, 


sO 


as claimed. 


Now, using induction, suppose we have already fixed k disjoint cubes J; in 
K°. By (1), there are cubes I € K° with 


k 
on es 
j=l 
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Let 6, be the lub of their diameters. As all I € K° lie in I°, 


k 
5 =supfdr| rex’, re-U5j} sar <oo 


j=l 


Hence by properties of the lub, we find a cube I,41 € K° such that 


k 
hO-UG 
and dT y41 > 55k 


In this way, taking k = 1,2,..., we select a disjoint sequence {I,} C K° 
with dIy41 > 55k for all k. We shall show that 


m'(A- v i) = 0 
k=1 


in four steps. 
(I) Let ¢, be the edge length of I,; so dx = €y./n. (Why?) 
Enclose each J; in a cube J; with the 


same center and with edge length Jk 
(4n + 1) Ly. 
Then £k 
ze I) (V9E In) = 
(Vz e k) ( Y k a ge Ay as a 
(2) ply) > 2nk_ = Ql /n 
= 2dlIx > dp_1.- 
(See Figure 32, where n = 2.) Also, ss 
k 


mJ, = (4n +1)" mig. 


(II) As the J; lie in I°, the c-additivity of m yieldsF!GURE 82 
So mdJn = (4n+1)” So mh 
k=1 k=1 


= (4n+1)"m U Te 
k=1 
< (4n+1)" mI? < oo. 


Thus the series }> mJ;, converges; so its “remainder” tends to 0: 


lim ae = 0. 
k=r 
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Also, mJ, — 0. But by definition, 
Ok < 2d p41 < 2dIp41 =2/n(MIpai)'/"  (n fixed). 


Hence lim 6, = 0, too. 


— CO 


(III) Now, seeking a contradiction, suppose 
m (4- g i) > 0. 
k=1 


Then as 
lim S° mJ_ = 0, 


T— 0° ae 
there is r such that 


a Jk Sa <m*(A- Un). 
k=r k=r 


k=1 


Hence 
A-JREU &. 
k=1 k=r 


(Why?) Thus there is 


pe A- U Ti, 
k=1 

not in 

U J es 

k=r 
so that 
(3) (Vk>r) p¢ Je, PEA, andpe-(JiC-\)J kh. 

k=1 k=r 
As 


k=1 
we find (as before) a cube kK € K° such that p € Kk and 


KaU b=. 


k=1 
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Also, as 6, — 0, we have 6, < dK for large k. But by our choice of the dx, this 
implies 


k 
Kn U I; x ) 
j=l 
for large k (why?), whereas 
Kn U fei), 
j=l 


as shown above. 
Thus there is a least k > r, call it q, such that 


Knig-4%, 


and 0g < dK < 0q-1. 


By (3), Dg Jq. As 
Kile -V, 


let 2E KN Iq. Since z, pe K, 
pl@,B) S dK < 0g—4. 
But as Z € I, and p ¢ Jz, we have 
pS. p) > 0g<i 
by (2). 


This contradiction proves the theorem for bounded sets A. 
(IV) If A is not bounded, use Lemma 2 in §2 to find a sequence {K;} of 
disjoint half-open intervals with 


JK, =F DA. 


Let 
A; = AN K?, 
where K? is the open interval with the same endpoints; so mk; = mK? and 
Set 


so mZ = 0 and 
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(Why?) As A; = AN K?, we have 
(4) LJ 4i=An|) KP =AnN(E"-Z)=A-Z. 
i=1 1=1 


Clearly, each A; is covered in the V-sense by those K-cubes that lie in K?. 
Thus as shown above, 


(Vi) m'(4-Uni) =0 


for disjoint cubes I;; C K?. That is, 


(Vi) fF, 2 Ag 
J 


where 


Z,=Ai-Uhy 
j 


and mZ; = 0. Hence by (4), 


UUtsul%2U A= 4-2, 
i=1 j i i 
so that 


a,j 


Rearranging the J;; in a single sequence {J;,}, we complete the proof. 


Theorem 2. Ifm*A < oo in Theorem 1, then for every « > 0 there is a finite 
disjoint sequence {Ij} C K such that 


m(A- Ur.) <€. 
k 
Proof. Fix « > 0. As m*A < o, the G-regularity of m* (Theorem 3 of §8) 
yields an open G D A such that 
mG <m*A+e. 


Clearly, A is covered in the V-sense by the subfamily K° of those K-sets that 
lie in G. Thus by Theorem 1, 


m*(A-[Jik) =0 
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for a disjoint sequence {I,} C K°. Also, 


Uh C&G, 


and so 
So mk =mUJh <mG < oo. 


Thus > mI, converges; so 
(oe) 
ae mI, <€ 
k=r 


for large r. 
On the other hand, 


A-~Unce(4-Un)u Ty. 
k=1 k=1 k=r 
Hence 


m'(4- Un) <m*(A- Ute) +m Ue <0+ mh <<, 
k=1 


k=1 k=r k=r 


as required. 


As an application, we obtain the following important theorem. 


Theorem 3 (Lebesgue). If f: E' — E' is monotone, it is differentiable al- 
most everywhere (“a.e.”), i.e., on E! — Z for some Z of Lebesgue measure 
zero. 


We sketch the proof in a few steps (lemmas). These lemmas anticipate a 
more general approach to be taken in §12, with the notation in the following 
definition. 


Definition 3. 


Let m = Lebesgue measure and 
K = {all cubes I Cc E” with mI > 0}. 


Let 
s: M’ = [0,0], M'DK, 


be another measure in E”, finite on K. 
For any natural r > 0, and p € E”, we set 


sl _ 1 
.(p) =infs — | peleK, dl<- 
gr (Dp) int “1 | ve Ek <>} 
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Lemma 1. With the above notation, 0 < Ds < Ds < & a.e. on E”. 


and 
I i 1 
h,(p) =sup{ * perex, dI < \ 
mI Tr 


furthermore, we denote 


Ds(p) = up gr(p) and Ds(p) = inf h,(p). 


Clearly, {gr}T, {hr}{, and 
0< Ds = Jim gr < lim hy = Ds 
at each p € E”. (Why?) 
We also write J(Ds > i) for 
{z € J | Ds(z) > i}, 


J(Ds = a) for 
{z € J | Ds(Z) =a}, 


etc. 
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Proof Outline. Fix any open set J C E”, with mJ < ooand sJ < & (e.g., an 
open cube in K). 
For 7 = 1,2,... set 


and 


A; = J(Ds > i) 


Ki={rek| ros, 1 > ib 
mI 


Verify that K; is a V-covering of A;; so there is a disjoint sequence {I,} C Ki, 


with 


and 


m*(4i- (JI) =0 
hese, 


Hence (cf. Problem 3 below) 


mA: <mU k= om <= ook = 9 ks b= 1, 25.4% 


It follows that 


m A A; = 0. 
i=1 
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(Why?) But 


(Why?) This implies that 
mJ Ds =o) = 0; 
and so Ds < oo on J, except for a null set. 

But by Lemma 2 in §2, all of E” is a countable union of such sets J (open 
cubes). Thus Ds < 00 on E” — Z, where Z is a countable union of null sets: 
mZ = 0. 

As 0 < Ds < Ds on all of E”, we have 


0<Ds<Ds<oo a.e. on KE”, 


as claimed. 


Lemma 2. With the same notation, Ds = Ds a.e. on E”. 


Proof Outline. With J as in the previous proof, let 
iH = hs SDs). 
Then 4 is a countable union of sets 
Hyg =I Ds > e> a> Ds) 


over rational u,v. Thus it suffices to show that all such H,,, are m-null. 
Let Q be one of them; so Q C J and 


mQ<mJ < oo. 

Hence given ¢€ > 0, there is an open set G C J with G D> Q and 
mG <m*Qt+e. 

(Why?) We fix this G and set 


K={reK|1c6, “<ul, 


mI 
By the definition of Ds, K is a V-covering of Q (verify!); so by Problem 3, 
m*(QnL iz) =m*@ 


for a disjoint sequence 
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Let 
G=|(J RR 
k=1 
(an open set), and Q, = QNG"; so 


mQ=m*Qo <mG* <mG <m*Q+t+e. 


(Explain!) 
Next, let 


K'={reK|ice’ =>} 
m 
It is a V-covering of Q, (why?); so 
m*(Qo-Lik) ~0 
for a disjoint sequence {Ij} C K’. Verify that 
u-(m*Q +e) >u-mG! =u-S > mip 
>So slp = sG" 
>So shi 
>u: Simi, =u-mUh 
> vem (QU te) =v:-m*Q,=v-m*Q. 


Thus 
(Ve>0) u-(m*Q+e)>u-m*Q. 
Making ¢ — 0, we get 
u-m*Q>vu-m*Q. 


Asu<v, m*A must be 0. This is the desired result. 


Proof of Theorem 3. To fix ideas, let fT. 
Let s = my be the f-induced LS measure in E' (89) so that 
s[p, x] = f(a+) — f(p—). 
By Lemmas 1 and 2, it suffices to show that f is differentiable at every p € E!, 
with 
Ds(p) = Ds(p) # ov. 


Fix any such p and set 
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Then f is continuous at p; for otherwise, 


Fer =jip) So, 


whence 
Ds(p) = oo. 


(Why?) Also, by Definition 3, given « > 0, there is a natural r such that 


q—€<49,(p) <hp(p) <qte. 


LE @,(-). 


Let 


If g > p, then 
Az =xz-—p=m)p, 2], 


and by continuity, 
Af = f(x) — fp) < f(t) - fle) 


= f(a+) — fp-) = slp, 2] 
< Az -h,(p) < Ax(q+e). 


Also, if x > y > p, then 
Af = f(yt+) — f(p—) = s[p, y] = Ay: ar(p) > Ay(q - €), 


where 
Ay =y—p=mlp,y}. 
Making y 7 x, with x fixed, we get 
(q—e)Ar < Af < (qte)Ag. 


Similarly in the case x < p. 
Thus with ¢ — 0, we obtain 


f'(p) = lim af ato. 


Problems on Vitali Coverings 


1. Prove Theorem 1 for globes, filling in all details. 
[Hint: Use Problem 16 in §8.] 


=>2. Show that any (even uncountable) union of globes or nondegenerate 
cubes J; C E” is L-measurable. 
[Hint: Include in K each globe (cube) that lies in some J;. Then Theorem 1 represents 
U Ji as a countable union plus a null set.] 
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3. Supplement Theorem 1 by proving that 


m*(A-LJ re) =0 


m*A=m*(AnLIR); 


here J° = interior of I. 


and 


4. Fill in all proof details in Lemmas 1 and 2. Do it also for K = {globes}. 


5. Given mZ = 0 and « > 0, prove that there are open globes 


G, CE”, 
with 
ZoUG 
k=1 
and on 
> mG; <€ 
k=1 


[Hint: Use Problem 3(f) in §5 and Problem 16(iii) from §8.] 
6. Do Problem 3 in §5 for 
(i) C’ = {open globes}, and 
(ii) C’ = {all globes in E”}. 


[Hints for (i): Let m’ = outer measure induced by v’: C’ > E+. From Problem 3(e) 
in 85, show that 
(VAC E") m'A>m*A. 


To prove m’A < m*A also, fix e > 0 and an open set G D A with 
m*A+e>mG (Theorem 3 of §8). 
Globes inside G cover A in the V-sense (why?); so 
ACZU 'S Gy, (disjoint) 
for some globes Gy and null set Z. With Gf as in Problem 5, 


mA < So (mG +mGzZ) <mGt+e< m*A + 2¢,] 


onto 


7. Suppose f: E” —> E” is an isometry, i.e., satisfies 
f(z) -— f@)| =|e—-g| for Z,ye EB”. 
Prove that 
(i) WAC BE") m*A=m* f|Al, and 
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(ii) A € M* iff f[A] © M*. 


[Hints: If A is a globe of radius r, so is f[A] (verify!); thus Problems 14 and 16 in §8 
apply. In the general case, argue as in Theorem 4 of §8, replacing intervals by globes 
(see Problem 6). Note that f~! is an isometry, too.] 


From Problem 7 infer that Lebesgue measure in E” is rotation invariant. 
(A rotation about p is an isometry f such that f(p) = p.) 


A V-covering K of A C E” is called normal iff 
(i) WIe€K)0<mI=mI°, and 
(ii) for every p € A, there is some c € (0,00) and a sequence 
Ik>p (Uk} CK) 
such that 
(VA) Geube Jy Dik) et lp > mid ps 


(We then say that p and {J;,} are normal; specifically, c-normal.) 


Prove Theorems 1 and 2 for any normal K. 
(Hints: By Problem 21 of Chapter 3, §16, dI = dl. 
First, suppose K is uniformly normal, i.e., all p € A are c-normal for the same c. 


In the general case, let 
A, ={Z€ A|Zisinormal}, i=1,2,...; 


so K is uniform for A;. Verify that A; 7 A. 
Then select, step by step, as in Theorem 1, a disjoint sequence {J;,} C K and 


naturals ny < ng <-:+< nj <--+ such that 
ae ‘i. 1 
(vi) m (4. UU) Is) <=. 
a 
k=1 
Let 
= |) Ty 
k=1 
Then i 
(Vi) m*(A;-—U)< - 
a 
and 


A= fA 


(Why?) Thus by Problems 7 and 8 in §6, 


m*(A—U) < lim E 26 


i—oo 4 


9. A V-covering K of E” is called universal iff 


(i) WIEK )0<mI=mI? <o, and 
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10. 


11. 


(ii) whenever a subfamily KC K covers aset A C E” in the V-sense, 
we have 
m* (4 — U I ‘) =0 
for a disjoint sequence 
Se ee oe 
Show the following. 
(a) K CM’. 
(b) Lemmas 1 and 2 are true with K replaced by any universal K. (In 
this case, write D*s and D's for the analogues of Ds and Ds.) 
(c) Ds = D"s Ds=Ds ae. 


(Hints: (a) By (i), I =7 minus a null set Z CT —I°. 


(c) Argue as in Lemma 2, but set 


Q=J(D*s>u>v> Ds) 


Ki ={reR 


ICG, ool 
mI 


to prove a.e. that D*s < Ds; similarly for Ds < D*s. 
Throughout assume that s: M! — E* (M’ > KUK’) is a measure in E”, finite 
on KUK’] 


Continuing Problems 8 and 9, verify that 

(a) K = {nondegenerate cubes} is a normal and universal V-covering 

of E”; 

(b) so also is K° = {all globes in E"}; 

(c) C = {nondegenerate intervals} is normal. 
Note that C is not universal. 
Continuing Definition 3, we call q a derivate of s, and write q ~ Ds(p), iff 

_ slp 
ioe ai 


for some sequence I, — p, with I, € K. 
Set 
Dp ={a€ E* | q~ Ds(p)} 


and prove that 
Ds(p) = min Dz and Ds(p) = max Ds. 


1 See M. E. Munroe, Measure and Integration, Addison-Wesley (1971), pp. 173-175. 
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12. Let K* be a normal V-covering of E” (see Problem 8). Given a measure 


sin E”, finite on K* UK, write 
q~ D*s(p) 
iff 
= lim sk 
— k—00 my 


for some normal sequence I; — p, with I, € K*. 


Set 
Do={aE E* |q~ D*s(p)}, 
and then 
D*s(p) = inf Dj and D s(p) = sup D5. 
Prove that 


Ds = D‘s =D s=Ds ae. on E”. 


[Hint: BE” = UP, Ej, where 
E, = {z € E” |Z is i-normal}. 


On each E;, K* is uniformly normal. To prove Ds = D*s a.e. on F;, “imitate” 
Problem 9(c). Proceed.] 


*811. Generalized Measures. Absolute Continuity 


I. We now return to general set functions s: M — E, with FE as in Definition 1 


of §4. 


Definition 1. 


A set function s: M — E is a generalized measure in a set S, and 
(S,M,s) is a generalized measure space, iff s is o-additive and semifi- 
nite (i.e., s A +00 or s # —oo) on M, a o-ring in S, and sf = 0. 

We call s a signed measure iff E C E* (i.e., s is real or extended real); 
if s > 0 then s is a measure; s may also be complex (E = C) or vector 
valued. 


Definition 2. 


Given a set function s: M — E, we define its total variation 
us: M = [0, 00] 


by 
(VAEM) v,A= sup )> |sX;|, 
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taking the sup over all countable disjoint subfamilies {X;} C M with 
Uj, % GA. 


Note 1. If M is a o-ring, we may equivalently require that 


Uxi=A4 


with {X;} a disjoint sequence in M (add the term X, = A — |; X; if neces- 
sary).+ 


Corollary 1. [fs and v, are as in Definition 2, then 
(i) vs is monotone on M, and 
(ii) |sA| <vu,A for every AE M. 
Proof. For (i), let AC B, A,B € M. Take any disjoint sequence {X;} C M, 
with 
Ljeesee. 


By definition, 
> |sX;| < v,B. 
Thus v,B is an upper bound of all such sums, with LJ) X; C A. Hence 
1A= lub }> |sX;| < vsB, 


proving (i). 
To prove (ii), just let {X;} consist of A alone. 


Theorem 1. [f s: M — E is a generalized measure, then v, is a measure 


on M. 


Proof. By definition, v, > 0 on M, a o-ring, and v, = 0. (Why?) It remains 
to prove o-additivity. 
Thus let 
A= U Ay (disjoint), 


with A, A, € M. To show that 
UA = > Os Ans 


take any M-partition {X;} of A. Then 
(Vi) X;=X;NA=XiN|JAn =UJ(KiN An) (disjoint). 


nm 


T Any such {X;} is called an M-partition of A (Chapter 8, §1); it may consist of A alone. 
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Similarly, 

so by definition, 
Hence as 

we get 


S" |sX;i| = s 


a a 


< Tie An Xi) < So usd 
As {X;} was an arbitrary M-partition of A, 


v,A= sup) |sX;| < S> vsAn 


It remains to show that 


n 


S> UVsAn <UsA 


This is trivial if v,A = co. 
Thus let v,A < oo. Then 


(Vn) vusAn <vusA < co 


by Corollary 1(i). Now fix « > 0. By properties of lub, each A, has an M- 
partition, 
Ay, = U Xnk) 
k 


such that 


€ 
An ee an < S"|sXnal- 
k 
All X;,% combined (for all n and k) form an M-partition of A. Thus by defini- 


tion, 
v,A > sep |sXnz| > Yo (vs4n = =) > So usAn = 8, 
n k n n 


With e — 0, we get 


S> UVgAn <UsA 
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as required. 


Definition 3. 


Given 
s: M— Eandt: M' — E'? 


we say that s is 


(i) t-continuous (written s < t) iff 


UX =0 jsX|=0 (X EM’); 


(ii) absolutely t-continuous (or absolutely continuous with respect to 
t) iff 
u,X ~0=> sX — 0, 


1.€., 


(Ve>0) (36>0) (VX EM’) UX <6 => |X| <e; 
(iii) t-finite iff 


UX <0o0o ==} |sX|<co (X EM’). 


Corollary 2. If two set functions s,u: M — E are t-continuous (absolutely 
t-continuous) so are s+u, and so is ks for any k from the scalar field of E.° 


The proof is left to the reader. (Use Definition 3(i)(ii), quantified formula.) 
Theorem 2. Let s: M— E andt: M'— E’. 
(i) Ifs<t, then vs <t. 


(ii) If, in addition, s and t are generalized measures and vg, is t-finite, then 
both vs and s are absolutely t-continuous. 


(iii) us < t implies s < t (which is obvious). 
Proof. Fix A € M and any disjoint sequence X; € M, with 
LJ xic A. 
If vA = 0, then (Corollary 1) 
CPt) Xr 0: 


? For the rest. of this section, we assume that M and M’ satisfy X € M whenever X € M’ 


and v4X < oo. 
3If E = E*, we assume k € E!. If s is scalar valued, k may be a vector in E. 
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so by the t-continuity of s, |sX;| = 0, and hence 5° |s.X;| = 0. As this holds for 
any such sum, we also have 


v,A = sup) |sX;| =0 


whenever v;A = 0. This proves assertion (i). 
Now, let s and ¢ be as in (ii); so v,; and 1% are measures by Theorem 1. 
Suppose vu, is not absolutely t-continuous. Then 


de>0) (VO >0) (AX EM’) HX <dandv,X >e. 
(Why?) Taking 


— 
! 


fix (Vn) a set X, € M’, with 
UXn <2” and vgXp > €. 
Let a o 
¥ =|) Xpand Y=) 
n=1 


k=n 
so Y,Y, € M', Y, \Y, and 
UY n < S° UXk < S° o-* < ot, 
k=n k=n 
Thus by Theorem 2 in §4 (right continuity), 


uY = lim wY, < lim 2!7" =0. 
nm— oo n—-oco 


Hence by the t-continuity of v, (see (i)), 
UsY =O<eE. 
On the other hand, as Y,, > X,, we have 
UsYn > Ug Xn > E. 
Also, u:Y, < 2'~” implies vsY; < 00 (vu, is t-finite). Hence 


UsY = lim usYpn > €, 


a contradiction. Thus v, 7s absolutely t-continuous. 
So is s; for by Corollary 1(ii), we have 


(Ve>0) (456 >0) VX EM’) YX <6 = |sX|<U.X <e, 


proving (ii). 
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Note 2. Absolute t-continuity always implies t-continuity.* 


II. Special notions apply to signed measures. First of all, we have the following 
definition. 


Definition 4. 


A set AC S in a signed measure space (5, M,s) is called positive (nega- 
tive) iff sX > 0 (sX <0, respectively) whenever 


ADX, XEM. 
We set 
Mt ={X € M | X is positive} 
and 
M”~ ={X E€M|X is negative}. 
The easy proof of Lemmas 1 and 2 is left to the reader. 
Lemma 1. In any signed measure space, Mt and M~ are o-rings. 
Lemma 2. [f s,t are signed measures on M, then 
(i) so is ks (k € E+); 


(ii) so also are s +t, provided s ort is finite on M. 


Note 3. Lemma 2 applies to generalized measures s,t: M — E as well. 


Lemma 3. Let s: M — E* be a signed measure. Let AG M,0< sA < ow. 
Then A has a subset Q € M* such that 


0<sA<sQ<o. 


Proof. If Ac M?*, take Q = A. 


Otherwise, A has subsets of negative measure. Let then n, be the least 
natural for which there is a set A; € M, with 


1 
A, C A and sA, < ——. 
N41 
(why does such n exist?); then 


s(A—A;) > sA>0. 


Now, if A— Ay € M?™, take Q = A— Aj. If not, let nz be the least natural 
for which there is Az € M, with 


1 
Ay C A— A, and sAy < ——. 
ne 


“For if vuzX = 0, then v;X < 6 for any 5 > 0. Thus Definition 3(ii) implies (Ve > 0) 
|sX| < ¢; hence |sX| = 0. 
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Again, if 

2 
A-(JAi 

i=1 

is positive, put 
2 
Q=A-YAi 

i=l 


A3 C A-|J 4; 
i=1 
and 
1 
sAz <a ee 
N3 


Continuing, we either find the desired Q at some step or obtain a sequence 
{A;,} CM such that 


k 
1 
(1) (VkEN) sAy<—— and Ayy, CA-[J Ai 
Mk i=1 


(so the A; are disjoint). In the latter case, let 


Q@=A= |) Ay; 
k=1 
so 
A=QU U Ay, (disjoint), 
k=1 
and 


sQ + Se sA, = SA. 
k 
As |sA| < oo (by assumption), }> sAz converges. By (1), then, 
1 
S> — <) (—sA,) < co. 


Therefore, 


Le., 
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Also, as sAx, < 0 and sA > 0, we have 
sQ =sA— 5° sAg >sA>0. 


Now, given € > 0, choose k so large that 


our definition of the nz implies that @ can have no subsets X € M, with 


sX <-E<— 


Ne —-1- 


(Why?) As ¢ is arbitrary, Q has no subsets of negative measure. 
Thus Q€ Mt, QCA, and 


0<sA<sQ<~aM, 


as required. 


The following theorem is named after the mathematician Hans Hahn. 


Theorem 3 (Hahn decomposition theorem). In any signed measure space 
(S,M,s), there is a positive set P C S whose complement is negative. More- 
over, P or —P can be chosen from M, according to whether s #4 co or s # —oo 
on M. 

If S € M, both P and —P can be made s-measurable: 


PeMt* and-PEM-. 
Proof. By definition, s is semifinite; so s 4 00 or s # —oo on M; say, s £ +00. 
As M* is a o-ring (Lemma 1), the restriction of s to M* is a measure, with 
0<s<o 
on M*. Thus by Problem 13 in §6, we fix a set P € MT? such that 
sP =max{sX | X € M*} < oo. 


By Lemma 3, sP = maxsX, even on all of M. 


It remains to show that —P is negative. Suppose it is not. Then —P has a 
subset Y € M, with sY > 0; so 


YonP=@andYUPE™M. 
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By additivity, 
s(Y UP) =sY +sP > sP, 

contrary to the maximality of sP. This contradiction settles the case s # +00. 

In case s 4 —oo, consider —s, which by Lemma 2 is likewise a signed mea- 
sure, with —s 4 +00. By what was proved above, there is a set P’ € M that 
is positive for —s (hence negative for s), and whose complement is positive for 
S. 

Finally, if S € M, then P € M implies 


S—-P=—-PeM; 
so both P and —P are in M. Thus all is proved. 


Note 4. The set P in Theorem 3 is not unique. However, if P’ € M7 is 
another such set, then 


s(P — P’)=0=s(P’ — P), 
i.e., any two such sets can differ by a set of measure 0 only. Indeed, 
P—P’CPandP-P’C-P; 
so s(P — P’) is both > 0 and < 0. Thus s(P — P’) =0. Similarly for P’ — P. 


Theorem 4 (Jordan decomposition). Every signed measure s: M — E* is 
the difference of two measures, 


s=st—s  (st,s~ >0), 
with st or s~ bounded on M. 


Proof. Suppose s 4 +oo on M. Then by Theorem 3, there is a set P € Mt 
such that —P is negative and sP < oo. Now define, for all sets A € M, 


(2) stA=s(ANP) ands A=-—s(A-—P). 
By additivity, 
sA=s(ANP)+s(A—P)=stA-s_ A; 
so s = st —s~ on M, as required. Moreover, 
stA=s(ANP) >0, 
since AN P C P and P is positive. Similarly, 
s A=-s(A-P) 20, 


since A — P C —P and —P is negative. Thus s*,s~ > 0 on M, a o-ring. 
The o-additivity of st and s~ easily follows from that of s (we leave the 
proof to the reader). Thus s* and s~ are measures. 
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Finally, by (2), 
stA=s(ANP) <sP<ow 


for all A € M (for 
sP = max{sxX | X €« M}; 


see the proof of Theorem 3). Thus st is bounded, and all is proved. 
The case s #4 —oo is similar. 


Note 5. For any set X C A (X € M), we have 
sX=stX-—s X<stX <s'A, 


for st and s~ are > 0 and monotone. Thus st A is an upper bound of 
{sX | AD X € M}. 


By (2), this bound is reached when X = AN P; so it is a maximum. Similarly 
for s—; thus 


(3) stA=max{sX | AD X € M} and s A= max{—sX | AD X € M}. 
Note 6. The decomposition is not unique, for we also have 
s=(st +m) —(s~ +m) 


for any finite measure m on M. However, it becomes unique if we add condition 
(3). When so defined, st and s~ are called the Jordan components of s. 


Note 7. Formula (2) shows that 
(—s)t =s” and (—s)~ =st. 
Corollary 3. With s, st, and s~ as in (3), we have the following. 
(i) vs =s*t +57; hence if s is a measure (s~ = 0), then 
S25": 


(ii) vs is finite (t-finite, t-continuous, absolutely t-continuous) iff st and s~ 
are, 1.€., iff s is. 


Proof. We give only an outline here. 
(i) Take any M-partition 
A=|)JX;i (disjoint). 
Setting 
m=st+ ae 


verify that 
|s.X;| < mX; 
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and 
S"|sXi < So mX; = mL) x; = mA. 


Thus mA is an upper bound of sums 


This bound is reached when X; = AN P, X2 = A— P (P as in (2)). 


(ii) Use Theorem 2, Corollary 2, and Definition 3. Note that v, > |s|, s7, 
and s~. 


Corollary 4. A t-finite signed measure s is absolutely t-continuous iff it is 
t-continuous. 


In particular, this applies to finite measures. 
Corollary 4 follows from Theorem 2 and Note 2, by Corollary 3. 


Ill. If EF = £” (C™), the function 
si: M-E 
has n real (complex) components 


S1,--+ 5 8n; 


as defined in Chapter 4, 83. As in Theorem 2 of Chapter 4, 83, one easily 
obtains the following. 


Theorem 5. A set function s: M — E"(C”) is t-continuous (absolutely t- 
continuous, additive, o-additive) iff its n components are. Hence a complex 
set function s is t-continuous (etc.) iff its real and imaginary parts are. 


For o-additivity, one can argue as follows. Let 


A= U A; (disjoint), 


i=l 
with A, A; € M. Use Theorem 2 in Chapter 3, 815, with p = sA and 
Lin = ye sAj, 
i=l 


to get p, = s,A, and 


m 
mk = ; spAj, eS let en: 
i=1 
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Theorem 6. A generalized measure s: M — E” (C”) is t-continuous iff it is 
absolutely t-continuous. It is always bounded on M, as is vs. 


Proof. As s: M — E” is o-additive, so is each of its components s;,, by 
Theorem 5. Thus each s, is a finite (real) signed measure, with 


— et _ em 


as in Theorem 4. Here the measures s; and s, are both finite (as s is). 


Thus by Problem 13 in 86, they are bounded, say, a < Kk, ands, < Ke on 
M. Hence by Corollaries 1 and 3, 


lsc] < Us, = 8, +8% < Ki + Ko; 


that is, vs, is bounded on M (k = 1,2,... ,7). Hence so are s and vz, for 
Is|) Sus < > tm 
k 


(see Problem 4(iii)). 

Now, as vg is finite, it is certainly t-finite. Thus by Theorem 2 and Note 2, 
s is t-continuous iff it is absolutely t-continuous. 

This settles the case E = E”, hence also E = C = E?. The case E = C” is 
analogous. 


IV. Completion of a Generalized Measure. From Problems 14 and 15 of §6, 
recall that every measure m has a completion m. A similar construction, which 
we now describe, applies to generalized measures s: M — E. 

Given such an s, let M be the family of all sets X U Z, where X € M and 
Z is vs-null, i.e., Z CU for some U € M, v,U = 0 (note that v, is a measure 
here, by Theorem 2). That is, 


M={XUZ|XEM, ZCU,UEM, v,U = 0}. 
We now define §: M — E by setting 
SA = 5X 


whenever A= X UZ, with X and Z as above. 

As in Problems 14 and 15 of §6, it follows that M is a o-ring D M, and 
that 5 is a o-additive extension of s, hence a generalized measure. We call § 
the completion of s. It is complete in the sense that M contains all v,-null sets 
(but it may miss some subsets of X with sX = 0). If s > 0 (a measure), then 
S$ = Us; so our present definitions agree with Problem 15 in §6. We use these 
ideas in the following part. 
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V. Signed Lebesgue—Stieltjes (LS) Measures. Motived by Theorem 3 in 
Chapter 5, §7, we shall say that a function 


a: El > E! 
is of bounded variation on E' iff 

C=f=7; 
with gf and hf on all of E!. 


Then g and h induce two LS measures m, and my, in E!. 
Let j1g and pup, be their restrictions to the Borel field B in E!. Then 
Oey = bg — bh 
is finite for sets X € B inside any finite interval J Cc E+ (as lg and pp, are finite 
on intervals). 

By Lemma 2, o% is a signed measure on the B-sets in J. Moreover, 07, does 
not depend on the particular choice of g} and h} (g-—h=a) on I. For if also 
a=u-—v (uf, vt) on E},” set 

TF = Bu — by: 
Then for any (z,y] C J, 
oo (2, y] = a(yt+) — a(zt+) = o4(2,y]  (verify!); 
so by Problem 13 in §5, 0/4, = 0% on B-sets in I. 
Thus o% is uniquely determined by a. Its completion 
=o° 


is the a-induced Lebesgue—Stieltjes (LS) signed measure in I. 
If further j1g or fp is finite on all of B, the same process defines a signed LS 
measure in all of E!. 


Problems on Generalized Measures 
1. Complete the proofs of Theorems 1, 4, and 5. 
1’. Do it also for the lemmas and Corollary 3. 


2. Verify the following. 


(i) In Definition 2, one can equivalently replace “countable {X;}” by 
“finite {.X;}.” 


(ii) If M is a ring, Note 1 holds for finite sequences {X;}. 


(iii) If s: M — E is additive on M, a semiring, so is vs. 
[Hint: Use Theorem 1 from §4.] 
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3. For any set functions s,t on M, prove that 
(i) vjs; = Us, and 
(ii) Use < avz, provided st is defined and 
a =sup{|sX|| X € M}. 


4. Given s,t: M — E, show that 
(i) Use S Us + v4} 
(ii) Ups = |klvs (kK as in Corollary 2); and 
(iii) if f = BE” (C”) and 


n 
s= ; Sk€k, 
k=1 
then 


n 
Usp <us < y Usk: 
k=1 


[Hints: (i) If 
AD|J Xi (disjoint), 
with A;, xX; € M, verify that 
\(s +t) Xi] < |sXa] + [tXil, 
ye (s+ t)X;| <vsA+utA, etc.; 
(ii) is analogous. 
(iii) Use (ii) and (i), with |é,| = 1.] 


5. If gl, ht, and a = g—h on E', can one define the signed LS measure 
Sq by simply setting s. = mg — Mp, (assuming mp < oo)? 
[Hint: the domains of mg and m;, may be different. Give an example. How about 
taking their intersection?] 

6. Find an LS measure ma, such that @ is continuous and one-to-one, but 
Ma is not m-finite (m = Lebesgue measure). 
[Hint: Take 


and 


7. Construct complex and vector-valued LS measures s,: M* — E” (C”) 
in E}. 
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8. Show that if s: M — E”(C™”) is additive and bounded on M, a ring, 
SO IS Ug. 
[Hint: By Problem 4(iii), reduce all to the real case. 
Use Problem 2. Given a finite disjoint sequence {X;} CM, let Ut (U—) be the 
union of those X; for which sX; > 0 (sX; < 0, respectively). Show that 


S| sXi = sUt — sU~ < 2sup|s| < 00] 
9. For any s: M — E* and AE M, set 
stA=sup{sX |ADXeM} 


and 
s A=sup{-sX |ADX eM}. 


Prove that if s is additive and bounded on M, a ring, so are s* and s~; 


furthermore, 
1 
ie 3 es +s)>0, 
a cel 
s =—(v,—s) >0, 
2 
s=s*t—s , and 
eae ee 
[Hints: Use Problem 8. Set 
= a +s) 
= 5(%s : 


Then (VX €M|X C A) 


2sX = sA+sX —s(A—X) < sA+t (|sX| + |s(A—X)]) 
<sA+vusA = 28'A. 


Deduce that st+A < 8’A. 
To prove also that s’A < st A, let ¢ > 0. By Problems 2 and 8, fix {X;} C M, 


with 

A= LU X;, (disjoint) 

i=1 

and 

UVsA-—E< Se |sX;| 

i=1 
Show that 
28’ A—e=vsA+sA—e<sUt —sU~ +s) Xj = 2sUt 
i=l 

and 


2st A > 2sUt > 2s'A— el] 
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10. Let 
K = {compact sets in a topological space (.5,G)} 
(adopt Theorem 2 in Chapter 4, §7, as a definition). Given 
s: MoE, MO2°%, 
we call s compact regular (CR) iff 


(Ve>0) (VAEM) (AF EK) (AG EG) 
F,GeEM, FCACG, andv.G-—e<v,A<v,F +e. 


Prove the following. 
(i) If s,t: M — E are CR, so are s +t and ks (k as in Corollary 2). 


(ii) If s is additive and CR on M, a semiring, so is its extension to the 
ring M, (Theorem 1 in §4 and Theorem 4 of §3). 


(iii) If E = E”"(C”) and v, < co on M, a ring, then s is CR iff its 
components s,% are, or in the case E = E!, iff st and s~ are 
(see Problem 9). 


[Hint for (iii): Use (i) and Problem 4(iii). Consider vs(G — F’).] 


11. (Aleksandrov.) Show that if s: M — E is CR (see Problem 10) and 
additive on M, a ring in a topological space S, and if vs < oo on M, 
then v, and s are o-additive, and v, has a unique o-additive extension 
v, to the o-ring N generated by M. 

The latter holds for s, too, if S € M and E = E”(C”). 
[Proof outline: The o-additivity of vs results as in Theorem 1 of §2 (first check 
Lemma 1 in §1 for vs). 

For the o-additivity of s, let 


A= |J Ai (disjoint), A, Ai € M; 
i=1 
then 
r-1 co 
|s4 — S_ Ail < So veAi > 0 
i=1 i=r 
as r — oo, for 
So vs Ai = Us LU) Aj < 0coO 
i=1 i=1 


(Explain!) Now, Theorem 2 of §6 extends vs to a measure on a o-field 
M*DNIM 


(use the minimality of NV). Its restriction to N is the desired 0, (unique by 
Problem 15 in §6). 
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A similar proof holds for s, too, if s: M — [0,0o). The case s: M > E” (C”) 
results via Theorem 5 and Problem 10(iii) provided S € M; for then by Corollary 1, 
usS < oo ensures the finiteness of vs, st, and s~ even on N |] 


12. Do Problem 11 for semirings M. 
[Hint: Use Problem 10(ii).] 


*812. Differentiation of Set Functions 


In the proof of Theorem 3 in 810 and the lemmas of that section, we saw the 
connection between quotients of the form 


Af _ f(e)— fl) 
Ax Z—p 


and those of the form 
sl 


mI’ 


where m is Lebesgue measure and s is another suitable measure. With this in 
mind, we now use quotients s1/mI for forming derivatives of set functions. 


Below, m is Lebesgue measure in E”; 
K = {nondegenerate cubes}. 
Definition 1. 
Assume the set function 
s:M SE (M'2DK) 
in &” and that q € E. 
(i) We say that q is the derivative of s at a point p € E” iff 


for all sequences {I,} C K, with I, — p (see Definition 1 in §10), 
Notation: q 
a. ali = — : 
q=s(p) = 7 s(p) 
If, in addition, |g| < co, we say that s is differentiable at p. 
If 


for at least one such sequence I, — p, we call g a derivate of s at p 
and write 


q~ Ds(p). 
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If s’(p) exists, it is the unique derivate of s at p. 


(ii) In case E is E* or E', we admit infinite derivates and derivatives. 
For any set function 


s: M' > E* 
(measure or not) with 
JA’ > KR 
we also define = 
Ds(p) and Ds(p) 


exactly as in Definition 3 of §10. 


Equivalently, Ds(p) is the least and Ds(p) is the largest derivate 
of s at p (Problem 11 in §10). This shows that if E = E* or E = E', 
derivates exist at every p. 


Note 1. Hence g = s’(p) in E* iff 
q = Ds(p) = Ds(p). 


Note 2. We treat Ds, Ds, and s’ as functions on points of EB”. Thus they 
are point functions, even though s is a set function. 


The easy proofs of Theorems 1 and 2 (with K and M’ D K as above) are 
left to the reader. 


Theorem 1. /f s,t: M’ — E are differentiable at p, so are s+t and ks for 
any scalar k. (If s,t are scalar valued, k may be a vector.) Moreover, 


(g7) =2 he and (ka) =k’ Gen. 
(See also Problem 7.) 


Theorem 2. A set function s: M’ — E"(C") is differentiable at p iff its 
components $1, 82,...,8, are; and then 


Tr 
/ / / = al = 
8 = (8j)s.42 58,) = y €;s, at p. 
i=1 


In particular, for complex functions, 


yt sf - ! ae 
S =Sig tl: Siz, at p. 


The process described in Definition 1 will be called Lebesgue differentiation 
or K-differentiation, as opposed to “Q-differentiation,” defined next.! 


' We follow some ideas by E. Munroe here. 
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Definition 2. 


Let u* be a G-regular (§5) outer measure in a metric space (S,p); re- 
call that 


G = {all open sets in S}. 
Let uw: M — E* be the p*-induced (§6) measure in S. 
A countable (two-indexed) set family 
Cat eM Ce 12s) 


is called a network in S (with respect to ws and p) iff 
(i*) the space 


5= U U® (disjoint), i=1,2,..., 


n=1 
with 
C2 =o, 40=1,2,c.05 
(ii*) each U2*! is a subset of some U! (the U! decrease as i increases); 


(iii*) for each p € S, there is a sequence 


with I, — p; that is, 


PS () Tr, 
k=1 
and dl, — 0 (di, = diameter of J;, in (S,p)). 


Now, given any set function 
si: M’>E (M'2Q), 


we define derivatives, derivates (also Ds and Ds if E C E*), and differentia- 
bility exactly as in Definition 1, replacing K by , and Lebesgue measure m 
by p. 

Note that these derivates and derivatives depend not only on pz and p but 
also on the choice of Q. To stress this, one might write s/,. and D,.s for s’ and 
Ds, respectively. Mostly, however, no confusion is caused by simply writing s’ 
and Ds (and we shall do so). 


A network for E” is suggested in the “hint” to Problem 2 of §2. See also 
Note 3. 


? Thus for each fired i, the U* are disjoint. Also, p is o-finite, and S € M. 
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Theorems 1 and 2 carry over to 0-differentiation, with the same proofs. We 
shall also need a substitute for the Vitali theorem (Theorem 1 of §10). It is 
quite simple. 

Definition 3. 
Let 2 be as in Definition 2. A set family V C 2 is called an Q-covering 
of A C (S, p) iff 
ACU, 


where LW is defined to be Uxey X- 


Theorem 3. Let N be an Q-covering of A C S. Then there is a disjoint 
sequence 


{erCN 
with 
ACUh 
k 
so that 
w(4-Un) =0 
k 
and 


wA=1'(AnUn). 
k 


Proof. As V CQ, N consists of some of the U!. For each 3, let 
N= {Ui EN |n=1,...}, 


ie., N* consists of all US € N with that particular index i. 

Now, by Definition 2(i*)(ii*), any two U% are either disjoint, or one contains 
the other. (Why?) Thus to construct {J}, start with all the (disjoint) N+-sets 
(if V+ ¢ 0). Then add those U? € N? that are not subsets of any set from Nt 
and hence are disjoint from such sets. Next, add those U3 € N? that are not 
subsets of any set chosen from N! or NV, and so on. 

All U? so chosen form a disjoint subfamily K C N that covers all of A, as 


AC\JN=UK. 
(Why?) 
K is countable (as Q is); so we can put it in a sequence {J,}, with 


AC|J Ik (disjoint), 
k 


as required. 
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We can now prove our main result for K- and Q-differentiation alike. 
Theorem 4. 
(i) Ifs: M' > E* (E", C’) is a generalized measure in E™, finite on K, then 
s is differentiable a.e. on E” (under Lebesgue measure m). 


(ii) Similarly for Q-differentiation in (S,p), provided s is finite on Q and 
regular.? 


Proof. Via components and the Jordan decomposition (Theorem 4 of §11), 


all reduces to the case where s is a measure (> 0). Then the proof for K- 
differentiation is as in Lemmas 1 and 2 in §10. (Verify!) 


For Q-differentiation, the proof of Lemma 1 in §10 still works, with K- 
coverings replaced by Q-coverings. 


In the proof of Lemma 2, after choosing rationals v > u, we choose Q, 
GD Q, the Q-covering 


K={realice, a <ul 
pL 


of Q, and the sequence {I,} C K, as before. (In selecting G, we use the 
G-regularity of w*; the I, need not be cubes here, of course.) 

Then, however, instead of forming the set Q,, we use the regularity of s to 
select an open set G’ € M’ with 


G2Uh2e 
k 


and 
sG'—e<sJh < So sn. 


The set family 
I 
K={realrea, Tool 
pl 
is then an ()-covering of @ (why?); so we find a disjoint sequence {J;,} C K’ 


with 
QC JLEGEC 


and obtain 


u-(WQte)>upG>u-S ph > Yosh >sG’-e>) > sh,-e 
k k k 


>u- So ui,—e=u- pl h—ezu-w'Q-e. 
k 


3A signed measure s is called regular iff st and s~ are regular (Definition 4 in §7). A 
complex measure s is regular iff sre and sim are. Finally, s: M’ — E” (C”) is regular iff all 
its components s; are. 
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Thus 
(Ve>0) u-(W*QO+e) >u-p*Q-e. 


The rest is as in Lemma 2 of §10. 


Note 3. If u* = m*, K-derivatives equal 0-derivatives a.e. for a regular s 
(Problem 6). One may use 2 in E”, thus avoiding Theorem 1 of §10 (Prob- 
lem 13). 


Problems on Differentiation of Set Functions 


1. Complete the proofs of Theorems 1 to 4 in detail. Verify Note 1. 


2. Verify that the hint for Problem 2 in §2 describes a network for E” (see 
Note 3). 


3. Show that the measure yw in Definition 2 is necessarily topological. 
[Hint: Any G € G is a countable union of Q-sets. Why?] 

4. (i) Show that the derivates of s at p form exactly the set Dj of all 
cluster points of sequences sI;,/mI, with I, — p and {I,} C K. 
Do the same considering sequences sI,/ul, with I, — p and 
{Ip} CQ. 

(ii) Do Problem 11 in §10 for Q-differentiation. Must s be regular 

here? 


5. Verify that if 
(WIEQ) pl=pl?, 


then Theorem 4 holds for 0-differentiation even if s is not regular. 
[Hint: The proof of Lemma 2 of §10 holds unchanged.] 


6. Prove Note 3 assuming that (i) s is regular, or (ii) (VI € Q) pl = pI? 
(see Problem 5). 
[Hint: Imitate Problem 9(b) in §10 and the “Q” part in the proof of Theorem 4.] 


7. Prove for K- and Q-differentiation that if 
s=ttu (s,t,u: M'— E*) 
and if u is differentiable at p, then Ds = Dt4+u' and Ds = Dt+w’ at p. 


8. In Theorem 4 show that Ds = Ds a.e. even if s is not finite on all of 
K (Q), 
[Hint: For s > 0, Lemma 1 in §10, still holds. For signed measures, use Problem 7, 
noting that s+ or s~ is finite, hence differentiable a.e.] 


9. Prove that if f and s = my are as in the proof of Theorem 3 in 810, 
then s and f are differentiable at the same points in E!, and s’ = f’ 
there. 
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10. 


11. 


12. 
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[Hint: Use Note 1, Definition 1, and Chapter 5, §1, Problem 9, considering one-sided 
derivatives, f{ and f! |] 


Given a universal V-covering ae (see Problem 9 in §10), develop ae 
differentiation as in Definition 1, replacing K by K and writing s’*, 
Ds, . <x for s',, Ds, ete. 

Extend Theorems 1-4 and Problem 7 to K -differentiation. Under the 

assumptions of Theorem 4, show that s’* = s’ a.e. on E” (use Problem 9 
in §10). 
Given a normal V-covering K* of E” (Problem 8 in §10), develop K*- 
differentiation along the lines of Problem 12 in §10 (admitting normal 
sequences {J} only). Do the same questions as in Problem 10, for 
K*-differentiation. 


Describe what changes if, in Problem 11, we drop the normality restric- 
tion on sequences I, — p (call it strong K*-differentiation; write D**s, 
s**, ete.). 
Show that 
D'*s<D's<D s< D's 


1% 


on &”, and so the existence of s’** implies that of s’*. 
However the proof of Lemmas 1 and 2 in 810 fails for D**s and D's 
(at what step?). So does the proof of Theorem 4. What about Theo- 


rems 1 and 2? 


Chapter 8 
Measurable Functions. Integration 


§1. Elementary and Measurable Functions 


From set functions, we now return to point functions 
coe p’) 


whose domain Dy consists of points of a set S. The range space T' will mostly 
be EF, ie., E', E*, C, E”, or another normed space. We assume f(x) = 0 
unless defined otherwise. (In a general metric space T', we may take some fixed 
element qg for 0.) Thus Dy is all of S, always. 
We also adopt a convenient notation for sets: 
“A(P)” for “{2 € A | P(x)}.” 


Thus 


Definition 1. 
A measurable space is a set S 4 Q@ together with a set ring M of subsets 
of S, denoted (S,M). 

Henceforth, (S,M) is fixed. 

Definition 2. 

An M-partition of a set A is a countable set family P = {A;} such that 
A= U A; (disjoint), 

with A, A; ¢ M) : 

We briefly say “the partition A = LU Aj.” 


1D may be finite; it may even consist of A alone. 
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An M-partition P’ = {Bix} is a refinement of P = {A;} (or P’ refines 
P, or P’ is finer than P) iff 


k 


i.e., each Bj; is contained in some A;. 
The intersection P’\P” of P’ = {A;} and P” = {B,} is understood 
to be the family of all sets of the form 


AB tS 1c, 
It is an M-partition that refines both P’ and P”. 


Definition 3. 


A map (function) f: S — T is elementary, or M-elementary, on a set 
A e€ M iff there is an M-partition P = {A;} of A such that f is constant 
(f = a;) on each A;. 

If P = {Aj,...,Aq} is finite, we say that f is simple, or M-simple, 
on A. 

If the A; are intervals in E”, we call f a step function; it is a simple 
step function if P is finite.? 


The function values a; are elements of T (possibly vectors). They may be 
infinite if 7 = E*. Any simple map is also elementary, of course. 
Definition 4. 


A map f: S — (T,p’) is said to be measurable (or M-measurable) on a 
set A in (S,M) iff 


f= lim fm (pointwise) on A 


for some sequence of functions f,,: S — T, all elementary on A. (See 
Chapter 4, §12 for “pointwise.” ) 
Note 1. This implies A € M, as follows from Definitions 2 and 3. (Why?) 
Corollary 1. If f: S — (T,p’) is elementary on A, it is measurable on A. 


Proof. Set fn = f, m = 1,2,..., in Definition 4. Then clearly f,—- f 
on A. 


Corollary 2. If f is simple, elementary, or measurable on A in (S,M), it 
has the same property on any subset BC A with BE M. 


2 Only simple step functions are needed for a “limited approach.” (One may proceed from 
here to §4, treating m as an additive premeasure.) 
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Proof. Let f be simple on A; so f = a; on Aj, i= 1,2,... ,n, for some finite 
M-partition, A = Uj_, Ai. 
If AD Be M, then 


{BNA}, i=1,2,...,n, 


is a finite M-partition of B (why?), and f = a; on BN A;; so f is simple on B. 
For elementary maps, use countable partitions. 
Now let f be measurable on A, i.e., 


f= lim fim 


m— oo 


for some elementary maps f;, on A. As shown above, the f,,, are elementary 
on B, too, and fm — f on B; so f is measurable on B. 


Corollary 3. If f is elementary or measurable on each of the (countably 
many) sets Ay, in (S,M), it has the same property on their union A =U, An- 
Proof. Let f be elementary on each A, (so A, € M by Note 1). 

By Corollary 1 of Chapter 7, §1, 


A=| JA, =| Bs 


for some disjoint sets B, C An (By, € M). 
By Corollary 2, f is elementary on each B,; i.e., constant on sets of some 
M-partition {B,i} of B;. 
All B,; combined (for all n and all 7) form an M-partition of A, 
A=|)Ba=|) Bre: 


As f is constant on each B,,;, it is elementary on A. 
For measurable functions f, slightly modify the method used in Corol- 
lary 2. 


Corollary 4. If f: S — (T,p') is measurable on A in (S,M), so is the com- 
posite map go f, provided g: T — (U,p") is relatively continuous on f [A]. 


Proof. By assumption, 
f = lim fm (pointwise) 


for some elementary maps jf, on A. 
Hence by the continuity of g, 


I(fm(x)) > g(f(#)), 


i.e., 9° fm 2 gf (pointwise) on A. 
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Moreover, all go f,, are elementary on A (for go f, is constant on any 
partition set, if fim is). 
Thus go f is measurable on A, as claimed. 


Theorem 1. Jf the maps f,g,h: S + E'(C) are simple, elementary, or mea- 
surable on A in (S,M), so are f+, fh, |f\* (for real a £ 0) and f/h (af 
h #0 on A). 


Similarly for vector-valued f and g and scalar-valued h. 


Proof. First, let f and g be elementary on A. Then there are two M- 


partitions, 
A=|J4:=() 2: 


such that f = a; on A; and g = by on Bx, say. 
The sets A; By (for all i and k) then form a new M-partition of A (why?), 
such that both f and g are constant on each A; By (why?); hence so is f +g. 
Thus f +g is elementary on A. Similarly for simple functions. 


Next, let f and g be measurable on A; so 
f =lim fm and g = limg, (pointwise) on A 


for some elementary maps fm, 9m- 
By what was shown above, fm + gm is elementary for each m. Also, 


fim £9m — f +4 (pointwise) on A. 


Thus f +g is measurable on A. 
The rest of the theorem follows quite similarly. 


If the range space is E” (or C”), then f has n real (complex) components 
fi,--- fn, as in Chapter 4, §3 (Part II). This yields the following theorem. 
Theorem 2. A function f: S — E”(C™”) is simple, elementary, or measur- 
able on a set A in (S,M) iff all its n component functions fi, fo,..., fn are. 
Proof. For simplicity, consider f: S > E?, f = (fi, fa). 

If f; and fg are simple or elementary on A then (exactly as in Theorem 1), 
one can achieve that both are constant on sets A; 1 B;, of one and the same 
M-partition of A. Hence f = (fi, fo), too, is constant on each A; M By, as 
required. 

Conversely, let 


for some M-partition 
A=(JG. 


Then by definition, f; = a; and fg = b; on C;; so both are elementary (or 
simple) on A. 
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In the general case (E” or C”), the proof is analogous. 


For measurable functions, the proof reduces to limits of elementary maps 
(using Theorem 2 of Chapter 3, §15). The details are left to the reader. 


Note 2. As C = E?, a complex function f : S — C is simple, elementary, 
or measurable on A iff its real and imaginary parts are. 

By Definition 4, a measurable function is a pointwise limit of elementary 
maps. However, if M is a o-ring, one can make the limit uniform. Indeed, we 
have the following theorem. 


Theorem 3. If M is ao-ring, and f: S — (T,p’) is M-measurable on A, then 


f = lim gm (uniformly) on A 


for some finite elementary maps gm. 


Thus given € > 0, there is a finite elementary map g such that p'(f,g) <« 
on A.3-4 


The proof will be given in §2 for T = E*. The general case is sketched in 
Problem 7 of §2. Meanwhile, we take the theorem for granted and use it below. 


Theorem 4. If M is ao-ring in S, if 
fin — f (pointwise) on A 


(fm: S — (TL, p')), and if all fm are M-measurable on A, so also is f.4 


Briefly: A pointwise limit of measurable maps is measurable (unlike contin- 
uous maps; cf. Chapter 4, §12). 


Proof. By the second clause of Theorem 3, each fi, is uniformly approximated 
by some elementary map g,, on A, so that, taking e¢ = 1/m,m=1,2,..., 


di 
(1) P Um 2); Gm(@)) < . for all 2 € A and all m. 


Fixing such a g,, for each m, we show that gn, — f (pointwise) on A, as 
required in Definition 4. 


Indeed, fix any x € A. By assumption, f(x) — f(x). Hence, given 6 > 0, 
(Ak) (Vm>k) pl(f(2), fm(a)) <6. 


Take k so large that, in addition, 


vise: Sk 
m 


3 We briefly write p'(f,g) for supzeg p'(f (x), g(2)). 
4 The theorem holds also for T = E*, with p’ as in Problem 5 of Chapter 3, §11. 
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Then by the triangle law and by (1), we obtain for m > k that 
(£2), 9m(2)) < p'(F (2), fm(@)) + p'(Fm(2), 9m(2)) 
<0 = < 20. 
m 


As 6 is arbitrary, this implies p’(f(x),gm(x)) — 0, ie., gm(x) — f(x) for 
any (fixed) « € A, thus proving the measurability of f. 


Note 3. If 
M = B (= Borel field in S), 


we often say “Borel measurable” for M-measurable. If 
M = {Lebesgue measurable sets in E”}, 


we say “Lebesgue (L) measurable” instead. Similarly for “Lebesgue—Stieltjes 
(LS) measurable.” 


Problems on Measurable and 
Elementary Functions in (S,M) 


1. Fill in all proof details in Corollaries 2 and 3 and Theorems 1 and 2. 
2. Show that P’M P” is as stated at the end of Definition 2. 
3. Given AC S and f, fm: S — (T, p’), m=1,2,..., let 


H=A(fm— f) 


and 1 
a5 / aa 
Amn = A(0' (fm; f) < =). 
Prove that 


Co Ce CO 


(@) H=[)U [) Anni 


n=lLk=1-n=k 
(ii) He M if all A,,, are in M and M is a o-ring. 


[Hint: « € H iff 
(Vn) (Ak) (Wm >k) ce Amn. 


Why? 


3’. Do Problem 3 for T = E* and f = +00 on H. 
[Hint: If f = +00, Amn = A(fm > 7).] 
=>4. Let f: S — T be M-elementary on A, with M a o-ring in S. Show the 
following. 


(i) A(f =a) eM, A(f a) EM. 
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>6. 


=>7. 


=>8. 


(ii) If T = E*, then 
A(f <a), A(f 2 a), A(f > a), and A(f > a) 
are in M, too. 
(iii) VWBCT) AN f-l[Bl eM. 
(Hint: If 


and f = a; on Aj, then A(f = a) is the countable union of those A; for which a; = a.] 


. Do Problem 4(i) for measurable f. 


[Hint: If f = lim f, for elementary maps fm, then 
H = A(f =a) = A(fm — a). 


Express H as in Problem 3, with 
1 
Amn = A(hm <=), 
where hm = p'(fm,a) is elementary. (Why?) Then use Problems 4(ii) and 3(ii).] 
Given f,g: S— (T, p'), let h = O(f,9), 1.e., 


h(x) = p'(f(x), 9(2)). 

Prove that if f and g are elementary, simple, or measurable on A, so 
is h. 
[Hint: Argue as in Theorem 1. Use Theorem 4 in Chapter 3, §15.] 
A set B C (T, p’) is called separable (in T) iff B C D (closure of D) for 
a countable set DCT. 

Prove that if f: S — T is M-measurable on A, then f[A] is separable 
in T. 
[Hint: f = lim fm for elementary maps fm; say, 


fm =Qmi on Ami EM, 1=1,2,.... 


Let D consist of all am; (m,i = 1,2,...); so D is countable (why?) and D C T. 
Verify that 


(Vy € f[A]) Gee A) y= f(x) =lim fn(a), 


with fm(x) € D. Hence 
(Vy f[A]) yeD, 


by Theorem 3 of Chapter 3, §16.] 
Continuing Problem 7, prove that if B C D and D = {q,q,...}, then 


(vn) BC Uc. (2). 
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(Hint: If p € BC D, any Gp(+) contains some q; € D; so 


p (Pp, di) < -, or p € Ga, (-). 
Thus 2 
(VpeB) pel Ga(-)1 


i=1 Le 


9. Prove Corollaries 2 and 3 and Theorems 1 and 2, assuming that M is a 
semiring only. 


10. Do Problem 4 for M-simple maps, assuming that M is a ring only. 


§2. Measurability of Extended-Real Functions 


Henceforth we presuppose a measurable space (S,M), where M is a o-ring in 
S. Our aim is to prove the following basic theorem, which is often used as a 
definition, for extended-real functions f: S — E*. 


Theorem 1. A function f: S — E* is measurable on a set A € M iff it 
satisfies one of the following equivalent conditions (hence all of them): 


(i*) (Vae E*) A(f >a) eM; (ii*) (Vae E*) A(f >a) eM; 
(iii*) (Va € E*) A(f <a) EM; (iv*) (Vae E*) A(f <a) eM. 
We first prove the equivalence of these conditions by showing that (i*) > 
(ii*) = (iii*) > (iv*) => (i*), closing the “circle.” 
(i*) = (ii*). Assume (i*). If a = —o0, 
A(f>a)=AEM 


by assumption. If @ = +c0, 


(Verify!) By (i*), 
A(f >a *) EM; 
n 


so A(f >a) € M (a o-ring!). 
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(ii*) = (iii*). For (ii*) and A € M imply 
A(f <a)=A-A(f Salem. 
(iii*) > (iv*). Ifa € E’," 
a 1 
< = - 
A(f <a) (Ale <a+-) eM. 
What if a = oo? 
(iv*) = (i*). Indeed, (iv*) and A € M imply 
A(f >a)=A-A(f <a) EM. 


Thus, indeed, each of (i*) to (iv*) implies the others. To finish, we need two 
lemmas that are of interest in their own right. 


Lemma 1. Jf the maps fm: S — E* (m = 1,2,...) satisfy conditions (i*)- 
(iv*), so also do the functions 
sup fm, inf fm, lim fm, and lim fm, 
defined pointwise, i.e., 
(sup fm)(@) = sup fm(«), 
and similarly for the others. 


Proof. Let f =sup f,. Then 


A(f <a) = [ | AUfm <a). (Why?) 


1 


i >~ 


But by assumption, 
A(fm <a) EM 
(fm satisfies (iv*)). Hence A(f <a) € M (for M is a o-ring). 
Thus sup fim satisfies (i*)—(iv*). 
So does inf f,,; for 


A(inf fm > a) = A(fm 2a) EM. 


1 


i 8 


(Explain!) 
So also do lim f,, and lim f,,; for by definition, 


lim fm = SUP Jr, 
k 


where 


— inf i 
Dk A 
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satisfies (i*)—(iv*), as was shown above; hence so does sup gx = lim fim. 


Similarly for lim fy. 


Lemma 2. /f f satisfies (i*)—-({iv*), then 
f= lim fm (uniformly) on A 
for some sequence of finite functions fm, all M-elementary on A. 
Moreover, if f > 0 on A, the fm can be made nonnegative, with {fm}T on A. 
Proof. Let H = A(f = +00), K = A(f = —oo), and 


form =1,2,... and k = 0,+1,+2,... ,+n,.... 
By (i*)-(iv*), 
H = A(f =+00) = A(f > +00) € M, 


Kk € M, and 
k-1 k 
= Fes, ae 
Bia A(f < ; }nA(f<s)em 
Now define t 
(Vm) tm = a on Amk, 

fm =m on H, and fm = —m on K. Then each f,, is finite and elementary on 
A since 


(Vm) A=HUKU a Amk (disjoint) 
k=—0o 
and fm is constant on H, K, and Am x. 
We now show that f,, — f (uniformly) on H, K, and 


j= v Aiynis 


k=—0o 


hence on A. 
Indeed, on H we have 


lim jf, = limm = +oo = f, 


and the limit is uniform since the f,, are constant on H. 
Similarly, 
fm = —m—-o=f on K. 
Finally, on Ams we have 


(hee? ape ho 
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and fim = (k —1)27-™; hence 
lfm — f| <k2-™ —(k=-1) 2-7 =2™. 


Thus 
lfm — f|<2-" 0 


on each Amz, hence on 


k=—0o 
By Theorem 1 of Chapter 4, §12, it follows that f,, — f (uniformly) on J. 
Thus, indeed, f;, — f (uniformly) on A. 

If, further, f > 0 on A, then K = @ and A,,, = 0 for k < 0. Moreover, 
on passage from m to m+ 1, each A,,, (& > 0) splits into two sets. On one, 
fm+i = fm; on the other, fmii > fm. (Why?) 

Thus 0 < fin 7 f (uniformly) on A, and all is proved. 


Proof of Theorem 1. If f is measurable on A, then by definition, f = lim f,, 
(pointwise) for some elementary maps f,,, on A. 

By Problem 4(ii) in §1, all f,, satisfy (i*)-(iv*). Thus so does f by Lemma 1, 
for here f = lim fm = limfim. 


The converse follows by Lemma 2. This completes the proof. 


Note 1. Lemmas 1 and 2 prove Theorems 3 and 4 of 81, for f: S — E*. 
By using also Theorem 2 in §1, one easily extends this to f: S — E”(C”). 
Verify! 


Corollary 1. If f: .S — E* is measurable on A, then 
(Vae E*) A(f=a)eM and A(f 4a) EM. 
Indeed, 
A(f =a)=A(f >a)NA(f<a)EeM 


and 


AiG Zsa AG = hem. 
Corollary 2. If f: S — (T,p') is measurable on A in (S,M), then 
Anf'[GlemM 
for every globe G = G,(6) in (T, p’). 
Proof. Define h: S — E' by 
h(x) = p'(f (x), 4). 
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Then h is measurable on A by Problem 6 in §1. Thus by Theorem 1, 
A(h< d) EM. 
But as is easily seen, 


A(h <6) ={x EA p'(f(x),9) <5} = AN f-"[G,(5)]. 


Hence the result. 


Definition. 


Given f,g: 5 — E*, we define the maps f V g and f Ag on S by 
(f V g)(a) = max{ f(x), g(x} 


and 
(f A g)(x) = min{ f(x), g(x)}; 
similarly for f Vg Vh, fAgAh, etc. 


We also set 
f* =fVv0and ff == v0. 


Clearly, ff >0 and f— >0o0nS. Also, f = ft — f~ and |f| = ft+f-. 
(Why?) We now obtain the following theorem. 


Theorem 2. If the functions f,g: S — E* are simple, elementary, or mea- 
surable on A, so also are ftg, fg, fV9, f Ag, f*, f-, and |f\* (a #0). 


Proof. If f and g are finite, this follows by Theorem 1 of 81 on verifying that 


fVg=5(F+9+If-al) 


and i 
frg=5Ft9-lf—gl) 


on S. (Check it!) 
Otherwise, consider 


A(f = +00), A(f = —oo), A(g = +00), and A(g = —oo). 


By Theorem 1, these are M-sets; hence so is their union U. 

On each of them f Vg and f Ag equal f or g; so by Corollary 3 in 81, f Vg 
and f A g have the desired properties on U. So also have ft = f V0 and 
f- =—-f V0 (take g = 0). 

We claim that the maps f + g and fg are simple (hence elementary and 
measurable) on each of the four sets mentioned above, hence on U. 


For example, on A(f = +00), 
f + 4 = +00 (constant) 
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by our conventions (2*) in Chapter 4, §4. For fg, split A(f = +00) into three 
sets Aj, Ao, Az € M, with g > 0 on Aj, g < 0 on Ag, and g = 0 on A3; so 
fg = +00 on A, fg = —oo on Ag, and fg = 0 on As. Hence fg is simple on 
A(f = +00). 

For |f|*, use U = A(|f| = 00). Again, the theorem holds on U, and also on 
A-U, since f and g are finite on A—U € M. Thus it holds on A = (A—U)UU, 
by Corollary 3 in §1. 


Note 2. Induction extends Theorem 2 to any finite number of functions. 


Note 3. Combining Theorem 2 with f = ft — f—, we see that f : 9 — E* 
is simple (elementary, measurable) iff ft and f~ are. We also obtain the 
following result. 


Theorem 3. [f the functions f,g: S — Ex are measurable on A € M, then 
A(f 2g) EM, Af <g) eM, A(f =g9) €M, and A(f #9) eM. 


(See Problem 4 below.) 


Further Problems on Measurable Functions in (S,M) 
1. In Theorem 1, give the details in proving the equivalence of (i*)—(iv*). 
2. Prove Note 1. 
2’. Prove that f= ft—f~ and |f|=ft+f-. 
3. Complete the proof of Theorem 2, in detail. 


=>4. Prove Theorem 3. 
[Hint: By our conventions, A(f > g) = A(f —g > 0) even if g or f is +00 for 
some « € A. (Verify all cases!) By Theorems 1 and 2, A(f — g > 0) € M; so 
A(f > 9) €M, and A(f < g) =A-—A(f > 9) € M. Proceed.] 

5. Show that the measurability of |f| does not imply that of f. 

[Hint: Let f = 1 on Q and f = —1 on A—Q for some Q ¢ M (QC A); eg., use Q 
of Problem 6 in Chapter 7, §8.] 

=>6. Show that a function f > 0 is measurable on A iff f,, 7 f (pointwise) 
on A for some finite simple maps fm > 0, {fm}. 
[Hint: Modify the proof of Lemma 2, setting Hm = A(f >m) and fm =m on Hm, 
and defining the A,,;, for 1 < k < m2™ only.] 

=>7. Prove Theorem 3 in §1. 
[Outline: By Problems 7 and 8 in §1, there are q; € T such that 


Set 


by Corollary 2; so p’( f(x), qi) < = on Ani. 
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=>8. 


=>9. 


10. 
11. 


12. 


Chapter 8. Measurable Functions. Integration 
By Corollary 1 in Chapter 7, 81, 
A= [J Ani = U Bni (disjoint) 
i=1 i=1 


for some sets Bni € M, Bni C Ani. Now define gn = qi on Bni; so p'(f, gn) < = on 
each B,;, hence on A. By Theorem 1 in Chapter 4, §12, gn — f (uniformly) on A.] 


Prove that f: 9 — E! is M-measurable on A iff AN f~'[B] € M for 
every Borel set B (equivalently, for every open set B) in E'. (In the 
case f: S — E*, add: “and for B = {+oo}.”) 
[Outline: Let 

R={X CB" | Anf-"[X] © M}. 


Show that R is a o-ring in E!. 


Now, by Theorem 1, if f is measurable on A, R contains all open intervals; for 
AN f-"[(a,b)] = A(f > a) N A(f <8). 


Then by Lemma 2 of Chapter 7, §2, R DG, hence R D B. (Why?) 
Conversely, if so, 


(a,0o) ER > ANF 7'[(a,00)] eM => A(f >a) EM] 


Do Problem 8 for f: S — E”. 
(Hint: If f = (fi,...,fn) and B = (a,b) C E”, with @ = (a1,... ,an) and b = 
(b1,...,6n), show that 


Pe) = (ite Woaea ll: 
k=1 

Apply Problem 8 to each f,: S — Et and use Theorem 2 in §1. Proceed as in 
Problem 8.] 
Do Problem 8 for f: 5 — C”, treating C” as E?”. 
Prove that f: S — (T,p’) is measurable on A in (S,M) iff 

(i) AN f~'[G] € M for every open globe G C T, and 

(ii) f[A] is separable in T (Problem 7 in 81). 


[Hint: If so, proceed as in Problem 7 (without assuming measurability of f) to show 
that f = limg, for some elementary maps gy, on A. For the converse, use Problem 7 
in §1 and Corollary 2 in §2.] 
(i) Show that if all of T is separable (Problem 7 in §1), there is a 
sequence of globes G, C T such that each nonempty open set 
BCT is the union of some of these Gx. 


(ii) Show that E” and C” are separable. 


[Hints: (i) Use the Gq,(4) of Problem 8 in §1, putting them in one sequence. 
(ii) Take D = R” C E” in Problem 7 of §1.] 
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13. Do Problem 11 with “globe G C T” replaced by “Borel set B C T.” 
[Hints: Treat f as f: AT’, T’ = f[A], noting that 
AT BiaAnyenr 


By Problem 12, if B 4 @ is open in T, then BMT" is a countable union of “globes” 
GqMT"’ in (I’,p’); see Theorem 4 in Chapter 3, §12. Proceed as in Problem 8, 
replacing E! by T\] 

14. A map g: (T,p') — (U,p") is said to be of Batre class 0 (g € Bo) on 
D CT iff g is relatively continuous on D. Inductively, g is of Batre 
class n (g € Bn, n > 1) iff g = limg,, (pointwise) on D for some maps 
Im © Byn-1. Show by induction that Corollary 4 in $1 holds also if 
g € B, on fA] for some n. 
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I. Henceforth we shall presuppose not just a measurable space (§1) but a mea- 
sure space (S,M,m), where m: M — E* is a measure on a o-ring M C 2°. 

We saw in Chapter 7 that one could often neglect sets of Lebesgue measure 
zero on E”—if a property held everywhere except on a set of Lebesgue measure 
zero, we said it held “almost everywhere.” The following definition generalizes 
this usage. 


Definition 1. 


We say that a property P(x) holds for almost all x € A (with respect to 
the measure m) or almost everywhere (a.e.(m)) on A iff it holds on A—Q 
for some Q € M with mQ = 0. 


Thus we write 
fn — f (ae.) or f =lim fy, (a.e.(m)) on A 


if f, — f (pointwise) on A — Q, mQ = 0. Of course, “pointwise” implies 
“a.e.” (take Q =), but the converse fails. 
Definition 2. 
We say that f: S — (T,p’) is almost measurable on A iff A € M and f 
is M-measurable on A — Q, mQ = 0. 


We then also say that f is m-measurable (m being the measure in- 
volved) as opposed to M-measurable. 


Observe that we may assume Q C A here (replace Q by AN Q). 


*Note 1. If m is a generalized measure (Chapter 7, §11), replace mQ = 0 
by UmQ = 0 (Um = total variation of m) in Definitions 1 and 2 and in the 
following proofs. 
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Corollary 1. If the functions 
iS S(T 6), A=1 Qe, 
are m-measurable on A, and if 
fn > f (a.e.(m)) 
on A, then f is m-measurable on A. 
Proof. By assumption, f, — f (pointwise) on A— Qo, MQo = 0. Also, fr, is 
M-measurable on 
A=OQn, MQ,=0, m= 12... 


(The Q,, need not be the same.) 
Let 


sO 


By Corollary 2 in §1, all f, are M-measurable on A— Q (why?), and f, — f 
(pointwise) on A—Q, as A—Q C A—Qo. 

Thus by Theorem 4 in $1, f is M-measurable on A— Q. As mQ = 0, this 
is the desired result. 


Corollary 2. If f =g (a.e. (m)) on A and f is m-measurable on A, so is g. 
Proof. By assumption, f = g on A— Q, and f is M-measurable on A — Qa, 
with mQ = mQs = 0. 

Let Q = Qi UQ2. Then mQ = 0 and g = f on A—Q. (Why?) 

By Corollary 2 of 81, f is M-measurable on A —Q. Hence so is g, as 
claimed. 


Corollary 3. If f: S — (T,p’) is m-measurable on A, then 
f = lim f, (uniformly) on A— Q (mQ = 0), 
for some maps fy, all elementary on A—Q. 


(Compare Corollary 3 with Theorem 3 in 81). 

Quite similarly all other propositions of §1 carry over to almost measurable 
(i.e., m-measurable) functions. Note, however, that the term “measurable” in 
§§1 and 2 always meant “M-measurable.” This implies m-measurability (take 
Q =0), but the converse fails. (See Note 2, however.) 

We still obtain the following result. 
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Corollary 4. If the functions 
fa: S—3> E* (n=1,2,...) 
are m-measurable on a set A, so also are 


sup fn, inf fr, lim fn, and lim fr. 


(Use Lemma 1 of §2). 
Similarly, Theorem 2 in §2 carries over to m-measurable functions. 


Note 2. If mis complete (such as Lebesgue measure and LS measures) then, 
for f: S > E* (E”", C”), m- and M-measurability coincide (see Problem 3 
below). 


II. Measurability and Continuity. To study the connection between these 
notions, we first state two lemmas, often treated as definitions. 


Lemma 1. A map f: S— E"(C”) is M-measurable on A iff 
Anf |B) eM 
for each Borel set (equivalently, open set) B in E” (C™). 
See Problems 8-10 in §2 for a sketch of the proof. 


Lemma 2. A map f: (5,9) — (T,p’) is relatively continuous on A C S iff for 
any open set B C (T, p’), the set AN f~*|B] is open in (A, p) as a subspace of 
(S, p). 

(This holds also with “open” replaced by “closed.” ) 
Proof. By Chapter 4, §1, footnote 4, f is relatively continuous on A iff its 
restriction to A (call it g: A — T) is continuous in the ordinary sense. 

Now, by Problem 15(iv)(v) in Chapter 4, §2, with S replaced by A, this 
means that g~!{B] is open (closed) in (A,p) when B is so in (T,p’). But 

g'[B]= {xe A| f(z) ¢ B}=ANf-"[Bl. 

(Why?) Hence the result follows. 


Theorem 1. Let m: M — E* be a topological measure in (S,p). If f: S > 
E” (C”) is relatively continuous on a set AE M, it is M-measurable on A. 


Proof. Let B be open in E” (C"). By Lemma 2, 
An f |B] 
is open in (A,p). Hence by Theorem 4 of Chapter 3, §12, 
Atif (2) =Aang 


for some open set U in (S, p). 
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Now, by assumption, A is in M. So is U, as M is topological (M D G). 
Hence 
Anf |B] =ANUEM 


for any open B C E” (C”). The result follows by Lemma 1. 


Note 3. The converse fails. For example, the Dirichlet function (Exam- 
ple (c) in Chapter 4, §1) is L-measurable (even simple) but discontinuous ev- 
erywhere. 


Note 4. Lemma 1 and Theorem 1 hold for a map f: S — (T,p’), too, 
provided f[A] is separable, i.e., 


f[A] GD 
for a countable set D C T (cf. Problem 11 in §2). 


“III. For strongly regular measures (Definition 5 in Chapter 7, §7), we obtain 
the following theorem. 


“Theorem 2 (Luzin). Letm: M — E* be a strongly regular measure in (S, p). 
Let f: S — (T,p’) be m-measurable on A. 
Then given € > 0, there is a closed set F C A (F' € M) such that 


mA-F)<e 
and f is relatively continuous on F’. 
(Note that if T = E*, p’ is as in Problem 5 of Chapter 3, §11.) 
Proof.' By assumption, f is M-measurable on a set 
H=A-Q,mQ=0; 


so by Problem 7 in §1, f[H] is separable in T. We may safely assume that f is 
M-measurable on S and that all of T is separable. (If not, replace S and T by 
H and f|H], restricting f to H, and m to M-sets inside H; see also Problems 7 
and 8 below.) 


Then by Problem 12 of §2, we can fix globes G1,G2,... in T such that 
(1) each open set B# in T is the union of a subsequence of {Gx}. 
Now let ¢ > 0, and set 
S=snf iGl=f Gis FH 123.5 


By Corollary 2 in 82, S, € M. As m is strongly regular, we find for each S;, 
an open set 
Ux 2) Sk; 


! For a simpler proof, in the case mA < oo, see Problem 10 below. 
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with U;, € M and 
€ 


Qk+1° 


Let By, = Ux — Sp, D =U; Br; so D€ M and 


m(U,, = Sk) < 


€ 1 
k k 
and 
(2) U;, — Bh = Sp = f “Gel. 


As D=\) Bx, we have 
(Vk) B,-D=B,N(-D)=0. 
Hence by (2’), 
(Vk) f-*[Gi] N(—D) = (Uy — Be) N (-D) 
= (Uz 1 (—D)) — (Ben (—D)) = Up N (-D). 
Combining this with (1), we have, for each open set B = LU), Gx, in T, 


(3) fBIN(-D)=YF eal (-D) =u. (-). 


Since the U;,, are open in S (by construction), the set (3) is open in S — D 
as a subspace of S. By Lemma 2, then, f is relatively continuous on S — D, or 
rather on 

H-D=A-Q-D 


(since we actually substituted S for H in the course of the proof). As mQ = 0 
and mD < $e by (2), 


mH —-D)<mA- se 
Finally, as m is strongly regular and H — D € M, there is a closed M-set 
FCH-DCA 
such that 
mH -D-F)< ae 
Since f is relatively continuous on H — D, it is surely so on F’. Moreover, 
A-F=(A-(H-D))U(H-D-F); 


sO 


m(A—F) <m(A-(H —D))+m(H — D F)<5et5ene. 


236 Chapter 8. Measurable Functions. Integration 


This completes the proof. 


*Lemma 3. Given [a,b] C E' and disjoint closed sets A,B C (S,p), there 
always is a continuous map g: S — |a,b] such that g = a on A andg = b 
on B. 
Proof. If A= or B=, set g =b or g =a on all of S. 

If, however, A and B are both nonempty, set 

(b == a)p(x, A) 
p(x, A) + p(x, B) 
As A is closed, p(x, A) = 0 iff x € A (Problem 15 in Chapter 3, §14); similarly 
for B. Thus p(x, A) + p(x, B) £0. 

Also, g=aon A,g=bon B,anda<g<bonS. 


g(x) = a4 


For continuity, see Chapter 4, §8, Example (e). 


*Lemma 4 (Tietze). If f: (S,p) — E* is relatively continuous on a closed set 
FCS, there is a function g: S — E* such that g = f on F, 


inf g[S] = inf f[F'], sup g[S] = sup f[F], 
and g is continuous on all of S. 


(We assume E* metrized as in Problem 5 of Chapter 3, §11. If |f| < co, the 
standard metric in E! may be used.) 


Proof Outline. First, assume inf f|F] = 0 and sup f[F] = 1. Set 


sar(rs))=Por-[lo] 


and 


2 2 
B= F( > =) =Foaf Fal 
f25 | 65 
As F is closed in S, so are A and B by Lemma 2. (Why?) 
As BN A=, Lemma 3 yields a continuous map gi: S — (0, s], with g,; = 0 
on A, and g; = 3 on B. Set fi = f—gi on F; so |fi| < 2, and f, is continuous 
on F. 


Applying the same steps to f; (with suitable sets A,B, C F), find a con- 
tinuous map go, with 0 < go < 2 : 3 on S. Then fo = fi — go is continuous, 
and 0 < fz < (3)? on F. 

Continuing, obtain two sequences {g,,} and {f,,} of real functions such that 
each gy is continuous on S, 
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and fn = fn—1 — Jn is defined and continuous on F’, with 
avn 
0<fr< (=) 
Stn a 


there (fo = f). 
We claim that 


9= I 
n=l 
is the desired map. 


Indeed, the series converges uniformly on S (Theorem 3 of Chapter 4, §12). 
As all gp, are continuous, so is g (Theorem 2 in Chapter 4, §12). Also, 


n ) n 
f§-doal < (5)" 0 
k=1 
on F' (why?); so f = g on F. Moreover, 


ee eh 
0<m<95)05(5) =1mS. 
n=1 


Hence inf g[S] = 0 and sup g[S] = 1, as required. 


Now assume 
inf f[F] =a<supf[F)=) (a,be€ E’). 
Set Ha) 
x)—a 
ee 
= 
so that inf h[F] = 0 and sup h[F] = 1. (Why?) 
As shown above, there is a continuous map go on S, with 
f-a 
b—a 


a+(b—a)go = 9. 


Then g is the required function. (Verify!) 


Finally, if a,b € E* (a < b), all reduces to the bounded case by considering 
HA (ax) = arctan f(x). 


“Theorem 3 (Fréchet). Let m: M — E* be a strongly regular measure in 
(S,p). If f: S > E* (E”, C”) is m-measurable on A, then 


f = Jim fi (a.e.(m)) on A 
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for some sequence of maps f; continuous on S. (We assume E* to be metrized 
as in Lemma 4.) 
Proof. We consider f: S — E* (the other cases reduce to E! via components). 


Taking ¢ = 4 (i = 1,2,...) in Theorem 2, we obtain for each i a closed 


M-set F; C A such that 


1 
a 


and f is relatively continuous on each F;. We may assume that F; C Fj+1 (if 
not, replace F; by U,._ Fx). 
Now, Lemma 4 yields for each 7 a continuous map f;: S — E* such that 


f, = f on F;. We complete the proof by showing that f; — f (pointwise) on 
the set 


and that m(A — B) = 0. 
Indeed, fix any x € B. Then x € F; for some 7 = ig, hence also for 7 > i 
(since {F;}1). As f; = f on Fj, we have 


(Vi>t) fix) = fla), 
and so f;(x) > f(x) for « € B. As F; C B, we get 


m(A-B) <m(A—F) <= 


for all 7. Hence m(A — B) = 0, and all is proved. 


Problems on Measurable Functions in (S,M,m) 


1. Fill in all proof details in Corollaries 1 to 4. 

1’. Verify Notes 3 and 4. 

2. Prove Theorems 1 and 2 in §1 and Theorem 2 in §2, for almost measur- 
able functions. 


3. Prove Note 2. 
[Hint: If f: S — E* is M-measurable on B = A—Q (mQ = 0, Q C A), then 
A= BUQ and 
(Vac k*) A(f>a)=B(f>a)UQf >a). 


Here B(f >a) € M by Theorem 1 in §2, and Q(f >a) € M if m is complete. For 
f:S— E”"(C”), use Theorem 2 of §1.] 

*4, Show that if m is complete and f: S — (T,p’) is m-measurable on A 
with f[A] separable in T, then f is M-measurable on A. 
[Hint: Use Problem 13 in §2.] 
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“5. 


*9. 
10. 


11. 


Prove Theorem 1 for f: S — (T,p’), assuming that f[A] is separable 
in T. 


. Given f, — f (a.e.) on A, prove that f, — g (a.e.) on A iff f = g (a.e.) 


on A. 


. Given A € M in (S,M,m), let ma be the restriction of m to 


Ma ={X EM|xX C A}. 
Prove that 
(i) (A,M.4,m,z) is a measure space (called a subspace of (5,M,m)); 


(ii) if m is complete, topological, o-finite or (strongly) regular, so 
is m4. 


(i) Show that if D C K C (T, p’), then the closure of D in the subspace 
(K, p') is KD, where D is the closure of D in (T, p’). 
[Hint: Use Problem 11 in Chapter 3, §16.] 

(ii) Prove that if B C K and if B is separable in (T,p’), it is so 
in (K, p’). 
[Hint: Use Problem 7 from §1.] 


Fill in all proof details in Lemma 4. 


Simplify the proof of Theorem 2 for the case mA < oo. 
[Outline: (i) First, let f be elementary, with f = a; on Aj € M, A = U, Ai 
(disjoint), > mA; = mA < ow. 

Given ¢ > 0, 


- - i 
(An) mA ee < 56 
Each A; has a closed subset F; € M with m(A; — Fi) < €/2n. (Why?) Now use 
Problem 17 in Chapter 4, 88, and set F = Uj_, Fi. 

(ii) If f is M-measurable on H = A— Q, mQ = 0, then by Theorem 3 in §1, 
fn — f (uniformly) on H for some elementary maps fn. By (i), each fn is relatively 
continuous on a closed M-set Fy, C H, with mH — mF, < ¢/2”"; so all fn are 


relatively continuous on F’ = (\7°_, Fn. Show that F is the required set.] 


Given f,: S > (T,p’), n=1,2,..., we say that 
(i) fn — f almost uniformly on A C S iff 


(V6 >0) (ADEM|mD<5d) fr, —-f (uniformly) on A— D; 


(ii) fn — f in measure on A iff 


(Vé,0 >0) (Ak) Wn >k) (AD, € M|mD, < 6) 
0'(f, fn) <o on A— Dy. 
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Prove the following. 


(a) fn — f (uniformly) implies f, — f (almost uniformly), and the 
latter implies both f, — f (in measure) and f, — f (a.e.). 


(b) Given f, — f (almost uniformly), we have f, — g (almost uni- 
formly) iff f = g (a.e.); similarly for convergence in measure. 


(c) If f and f, are M-measurable on A, then f, — f in measure on 
A iff 
(Vo >0) lim mA(p'(f, fr) 2 7) = 0. 


12. Assuming that f,: S — (T,p’) is m-measurable on A for n = 1,2,..., 
that mA < oo, and that f, — f (a.e.) on A, prove the following. 


(i) Lebesgue’s theorem: f, — f (in measure) on A (see Problem 11). 
(ii) Egorov’s theorem: f, — f (almost uniformly) on A. 
[Outline: (i) fn and f are M-measurable on H = A—Q, mQ = 0 (Corollary 1), 
with fn — f (pointwise) on H. For all i,k, set 


Hi(k) = 1) H(o' nS) <7) eM 


by Problem 6 in §1. Show that (Vk) Hi(k) 7 H; hence 
lim mH;j(k) =mH = mA < o; 
so 


(V6 > 0) (Vk) (Six) ~=m(A— Hi, (k)) < 


proving (i), since 
(Vn >in) p'(fn, f) < : on Hj, (k) = A—(A— Hi, (k)). 


(ii) Continuing, set (Vk) D, = Hi, (k) and 


CoO 


D=A-—[{) De= LU (A- Dy). 
k=1 k=1 


Deduce that D € M and 
CO CO 6 
mD < S_ m(A— Hi, (k)) < 5° oe =o 
k=1 k=1 


Now, from the definition of the H;(k), show that fn — f (uniformly) on A — D, 
proving (ii).] 


13. Disprove the converse to Problem 12(i). 
[Outline: Assume that A = [0,1); for all 0 < k and all 0 <i < 2*, set 


se i—1 i 
gin(2)=4 Ne SS a 
0 otherwise. 
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Put the giz in a single sequence by 


fok4i = Gik- 
Show that fn — 0 in L measure on A, yet for no x € A does fn(x) converge as 
n— co] 
14. Prove that if f: S — (T,p’) is m-measurable on A and g: T — (U, p”) is 
relatively continuous on f[A], then go f: S — (U, p”) is m-measurable 


on A. 
[Hint: Use Corollary 4 in §1.] 
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In Chapter 5, integration was treated as antidifferentiation. Now we adopt 
another, measure-theoretical approach. 

Lebesgue’s original theory was based on Lebesgue measure (Chapter 7, §8). 
The more general modern treatment develops the integral for functions f: S — 
E in an arbitrary measure space. Henceforth, (S,M,m) is fixed, and the range 
space E is E!, E*, C, E”, or another complete normed space. Recall that 
in such a space, >; |a;| < co implies that 5a; converges and is permutable 
(Chapter 7, §2). 

We start with elementary maps, including simple maps as a special case. 


Definition 1. 


Let f: S — E be elementary on A € M; so f = a; on A; for some 
M-partition 


1 


A= U A; (disjoint). 
(Note that there may be many such partitions.) 
We say that f is integrable (with respect to m), or m-integrable, on 


A iff 
S- |ai| mA; < oo. 


(The notation “|a;|mA;” always makes sense by our conventions (2*) in 
Chapter 4, §4.) If m is Lebesgue measure, then we say that f is Lebesgue 
integrable, or L-integrable. 

We then define [ ad, the m-integral of f on A, by 


(1) [taf fam= Dama, 


1 For a “limited approach,” use finite M-partitions and M-simple maps, treating m as 
an additive premeasure on M, a ring. 
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(The notation “dm” is used to specify the measure m.) 
The “classical” notation for [, f dm is [, f(x) dm(a). 


Note 1. The assumption 


S> la;| mA; < co 
implies 
(Vi) |a;| mA; < 00; 
so a; = 0 if mA; = ov, and mA; = 0 if |a;| = co. Thus by our conventions, all 
“bad” terms a; mA; vanish. Hence the sum in (1) makes sense and is finite. 


Note 2. This sum is also independent of the particular choice of {A;}. For 
if {B,,} is another M-partition of A, with f = by on Bx, say, then f = a; = by 
on A; By whenever A; By 4 9. Also, 


(Vi) A; =(J(AiNM Bx) (disjoint); 
k 


so 
(Vi) ajmA; = ee (Ain Bg), 


and hence (see Theorem 2 of Chapter 7, §2, and Problem 11 there) 
ee pe (A; By) = a N Br) = S/ bp mBg. 
k k 


(Explain!) 
This makes our definition (1) unambiguous and allows us to choose any 
M-partition {A;}, with f constant on each A;, when forming integrals (1). 


Corollary 1. Let f: S — E be elementary and integrable on A € M. Then 
the following statements are true. 


(i) |f| < 00 a.e. on A? 


(ii) f and |f| are elementary and integrable on any M-set B C A, and 


als fins fin 


(iii) The set B= A(f #0) is o-finite (Definition 4 in Chapter 7, §5), and 
he= he 
A B 


? That is, on A—Q for some Q € M, with mQ = 0. 
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(iv) If f =a (constant) on A, 


[i feema. 


(v) f,lfl =0 if f =0 ae. on A. 


(vi) If mQ =0, then 
ae 


(so we may neglect sets of measure 0 in integrals). 


(vii) For any k in the scalar field of E, kf is elementary and integrable, and 


[eran t 


Note that if f is scalar valued, k may be a vector. If EF = E*, we assume 
ke E'. 
Proof. 
(i) By Note 1, |f| = |a;| = co only on those A; with mA; = 0. Let Q be the 
union of all such A;. Then mQ = 0 and |f| < co on A — Q, proving (i). 
(ii) If {A;} is an M-partition of A, {BM A;} is one for B. (Verify!) We have 
f =a, and |f|=|a,| on BN A; C Ay. 
Also, 
S— |ail|m(B As) < S— Jai] mA; < co. 
(Why?) Thus f and |f| are elementary and integrable on B, and (ii) 
easily follows by formula (1). 


(iii) By Note 1, f = 0 on A; if mA; = co. Thus f £0 on A; only if mA; < oo. 
Let {A;, } be the subsequence of those A; on which f 4 0; so 


(Vk) mA;, < co. 


Also, 
B=A(f 40)=(JAi €M (o-finite!). 
k 


By (ii), f is elementary and integrable on B. Also, 
i f= Sos mA, , 
a k 


while 


[t=Dama. 
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These sums differ only by terms with a; = 0. Thus (iii) follows. 
The proof of (iv)—(vii) is left to the reader. 


Note 3. If f: S — E* is elementary and sign-constant on A, we also al- 
low that 
i f= Slama; = +00. 
A i 


Thus here | aJ exists even if f is not integrable. Apart from claims of inte- 
grability and o-finiteness, Corollary 1(ii)—-(vii) hold for such f, with the same 
proofs. 


Example. 


Let m be Lebesgue measure in E!. Define f = 1 on R (rationals) and 
f =0 on E' — R; see Chapter 4, §1, Example (c). Let A = [0,1]. 

By Corollary 1 in Chapter 7, 88, AN R € M* and m(AN R) = 0. Also, 
A-ReM*. 

Thus {AN R,A— R} is an M*-partition of A, with f=1lon ANR 
and f =O0on A— R. 

Hence f is elementary and integrable on A, and 


| f=ton(AAR)+6emtA—P) 0. 
A 
Thus f is L-integrable (even though it is nowhere continuous). 


Theorem 1 (additivity). 


(i) If f: S — E is elementary and integrable or elementary and nonnegative 
on AE M, then 


(2) hae ff 


for any M-partition {B,} of A. 
(ii) If f is elementary and integrable on each set By of a finite M-partition 


A=(JB, 
k 


it is elementary and integrable on all of A, and (2) holds again. 


Proof. (i) If f is elementary and integrable or elementary and nonnegative on 
A =U, Br, it is surely so on each B, by Corollary 2 of §1 and Corollary 1(ii) 
above. 
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Thus for each k, we can fix an M-partition By = U; Ari, with f constant 
(f = Gm) on Ags, t= 1, 2;.... Then 


A=UB:=UUAn 
k k 4 


is an M-partition of A into the disjoint sets Az; © M. 


Now, by definition, 
| f= 0 an: mAgi 
Br Fi 


and 


k 


/ f= Damm = (Lawman) => f 
A ka F k 7 Be 


by rules for double series. This proves formula (2). 
(ii) If f is elementary and integrable on B, (k = 1,...,n), then with the 
same notation, we have 


> |axi| MAps < OO 
i 


(by integrability); hence 


n 
> laxi| MAK < 00. 


k=1 7 


This means, however, that f is elementary and integrable on A, and so clause 
(ii) follows. 


Caution. Clause (ii) fails if the partition {B,} is infinite. 
Theorem 2. 


(i) If f,g: S > E* are elementary and nonnegative on A, then 


fura-frr fo 


(ii) If f,g: S — E are elementary and integrable on A, so is f +g, and 


[usa-fre fo 


Proof. Arguing as in the proof of Theorem 1 of $1, we can make f and g 
constant on sets of one and the same M-partition of A, say, f = a; and g = }; 
on A; € M; so 

ftg=a;+b; on Aj, 71=1,2,.... 
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In case (i), f,g > 0; so integrability is irrelevant by Note 3, and formula (1) 
yields 


[5 +9) = Dla tomac=Tamars Doimas= ft fo 


In (ii), we similarly obtain 


~~ la; + b;| mA; < > la;] mA; + > |bi| mA; < 00. 


(Why?) Thus f + g is elementary and integrable on A. As before, we also get 


[usa- fre fis 


simply by rules for addition of convergent series. (Verify!) 


Note 4. As we know, the characteristic function Cg of a set B C S' is 


defined 
1, «eB, 


Calz)= 
B(z) . p25 = 
If g: S — E is elementary on A, so that 

o= af on Ay, 1,2).42, 


for some M-partition 


A=JAi, 


g= So aia, on A. 


then 


(This sum always exists for disjoint sets A;. Why?) We shall often use this 
notation. 

If m is Lebesgue measure in E', y 
the integral 


= ale 
[3 ZA 


has a simple geometric interpretation; : 
see Figure 33. Let A = [a,b] c E!; | 
let g be bounded and nonnegative on ! 
E'. Each product a; mA; is the area roi 
of a rectangle with base A; and al- FIGURE 33 
titude a;. (We assume the A; to be 
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intervals here.) The total area, 
/ g= > a; mA;, 
A i 


can be treated as an approximation to the area under some curve y = f(x), 
where f is approximated by g (Theorem 3 in §1). Integration historically arose 
from such approximations. 


Integration of elementary extended-real functions. Note 3 can be extended 
to sign-changing functions as follows. 


Definition 2. 


If 
f=) wx (a; € E*) 
on 
A=J4Ai (Ai €™), 
we set 
_ i = 
(3) prepr-pr 
with 
ft =fVv0>0and f- =(-f)V0>0; 
see §2. 


By Theorem 2 in §2, f* and f~ are elementary and nonnegative on A; so 


[pt ana for 


are defined by Note 3, and so is 


ee 


by our conventions (2*) in Chapter 4, §4. 
We shall have use for formula (3), even if 


[tt=f =o 


then we say that Teg is unorthodox and equate it to +00, by convention; 
cf. Chapter 4, §4. (Other integrals are called orthodox.) Thus for elementary 
and (extended) real functions, |, f is always defined. (We further develop this 
idea in §5.) 
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Note 5. With f as above, we clearly have 
f° =a and f- =a; on:A,, 


where 
a; = max(a;,0) and a; = max(—a;,0). 
Thus 
| —_ Se -mA,; and | jf = Ye -mAj, 
A A 
so that 


(4) [tq forte f = Sat-ma-Dar ma, 


If f aad a Oe OE J ad < ©, we can subtract the two series termwise 
(Problem 14 of Chapter 4, §13) to obtain 


[te 26 a, )mA; =e 


for a; —a; = a;. Thus formulas (3) and (4) agree with our previous definitions.® 


Problems on Integration of Elementary Functions 
1. Verify Note 2 
1’. Prove Corollary 1(iv)—(vii). 


2. Prove that [, f =0 if mA =0 or f = 0 on A. Disprove the converse 
by examples. 


3. Find a primitive F for f = Cr in our example. Show that 


fdm = F(1) — F(0). 
[0.1] 


4. Fill in the proof details in Theorem 2. 


[Hint: Use comparison test for series.] 


=> 5. Show that if f and g are elementary and nonnegative with f > g on 


A, then 
| i= ‘ g= 0. 
A A 
[Hint: As in Theorem 2, let 


f => aCa, and g = 3° Ca,. 
Then f > g > 0 implies a; > b; > 0.] 


3 For a “limited approach,” pass from here to §9. 
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=>6. Prove that if f and g are elementary and (extended) real on A, then 
[ea- Aes G 
provided 


i) [, f or [,@ is finite, or 
(ii) ff. fyg, and f, f+ J, 9 are all orthodor. 
[Outline: As in Theorem 2, let 


= pr ore and g = So Cas 


so 
ftg=a,tb; on Aj. 


Now, if 


Ae 
A 


then by Problem 14 in Chapter 4, §13, and formula (4), > a; mA; converges ab- 
solutely; so its termwise addition to any other series does not affect the absolute 
convergence or divergence of the latter, i.e., the finiteness or infiniteness of its posi- 
tive and negative parts. For example, 


WC + by)t mA; = C 


4 


iff 
S¢ bf mA; = 00. 
Thus if 
| g=40, 
A 
then 
[rta=fg=t0=-f rx f 
A A A A 
If both 


[ff a8 t00, 


Theorem 2(ii) applies. In the orthodox infinite case, a similar proof works on noting 
that either the positive or the negative parts of both series are finite if 


ae 


7. Show that if f is elementary and nonnegative on A and 


[fore 
A 


is orthodox, too. (Verify!)] 
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then there is an elementary and nonnegative map g on A such that 


[te [a> 


f>gonA-—A(f =0). 


g =0 on A(f = 0), and 


[Hints: Let 
B= A(f =00) 


and 
C=A-—B; 


so B,C € M (Corollary 2 in §2). For all n > 0, define 
gn =nonB 

and 

1 

gn = (1- =) f on G; 

n 

sO gn is elementary and nonnegative on A and 
f > gn on A— A(f =0). (Why?) 


By Theorem 1 and Corollary 1(iv) (vii), 


[on = fant fama fmt f @-=)f=n-mB+ (1-2) [is 
Deduce that 
dim, fiom= fore [t= f t>e 


(3n) [a> 


so 


Take g = gn for that n.] 


. Show that if f = E*, Theorem 1(i) holds also if J, f is infinite but 


orthodox. 


(i) Prove that if f is elementary and integrable on A, so is —f, and 


[cn-- ft 


(ii) Show that this holds also if f is elementary and (extended) real 
and J, f is orthodor. 
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§5. Integration of Extended-Real Functions 
We shall now define integrals for arbitrary functions f: S — E* in a measure 
space (S,M,m).! We start with the case f > 0. 


Definition 1. 
Given f >00n AE M, we define the upper and lower integrals, 


fon fe 


of f on A (with respect to m) by 


@) iz : Is — ig | : 


over all elementary maps h > f on A, and 


(1”) [ t= f famasw fs 


over all elementary and nonnegative maps g < f on A. 
If f is not nonnegative, we use ft = f V0 and f~ = (—f) V0 (82), 


and set 
Jp] pimp [po 
[te f tame for -f rr. 


7 our conventions, these expressions are always defined. The integral 
Jaf (or ff) is called orthodos iff it does not have the form oo — oo in 


(1), eg., if f > 0 (ie, f~ =0), or if [, f < co. An unorthodox integral 
equals +co. 


We often write | for if and call it simply the integral (of f), even if 


Ve # | & 


“Classical” notation is [, f(x) dm(a). 


! Those who wish to consider measurable maps only should take Theorem 3 earlier. 
? There is good reason for identifying “integral” with “upper integral.” 
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Definition 2. 


The function f is called integrable (or m-integrable, or Lebesgue integrable, 
with respect tom) on A, iff 


[fam = ffm 4 20 


The process described above is called (abstract) Lebesgue integration as op- 
posed to Riemann integration (B. Riemann, 1826-1866). The latter deals with 
bounded functions only and allows h and g in (1’) and (1”) to be simple step 
functions only (see §9). It is inferior to Lebesgue theory. 


The values of _ 
/ f dm and / f dm 
A JA 


depend on m. If m is Lebesgue measure, we speak of Lebesgue integrals, in the 
stricter sense. If m is Lebesgue—Stieltjes measure, we speak of LS-integrals, 
and so on. 


Note 1. If f is elementary and (extended) real, our present definition of 


Is 


agrees with that of $4. For if f > 0, f itself is the least of all elementary and 
nonnegative functions 
h>f 


and the greatest of all elementary and nonnegative functions 
g9<f. 
Thus by Problem 5 in 84, 


[t= [ram [io 
fa-[e-f4 


If, however, f 7 0, this follows by Definition 2 in §4. This also shows that for 
elementary and (extended) real maps, 


1.€., 


Fae, always. 


(See also Theorem 3.) 
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Note 2. By Definition 1, 


[3 < ia always. 


For if f > 0, then for any elementary and nonnegative maps g, h with 


gi 7 Sh, 


19s J 


[ fase [9 


is a lower bound of all such I h, and so 


[ssa fn-fit 


In the general formula (1), too, 
fasfis 
224 A 


ie a) yp ond fF eT 


Theorem 1. For any functions f,g: S — E* and any set A € M, we have 
the following results.? 


(a) If f =a (constant) on A, then 


[fa f fooma 


(b) If f =0 on A or mA = 0, then 


[inf fro 
(c) If f >g on A, then 


Lele Lele 


3 Note that integrability is redundant here and in Theorem 2. 


we have 


by Problem 5 in §4. Thus 


since 
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Re and | f>0. 
ae | 


Similarly if f <0 on A. 
(e) If0O<p< ov, then 


(d) If f >0 on A, then 


(e’) We have 


[,co=-f[ 3 and f I --f f 


ADB, BEM, 
then — 
Lede ee 1) 
(g) We have 
TAsTanmelf le] 
(but not 


als fu 
in general). 


(h) If f > 0 on A and f,f = 0 (or f < 0 and ff = 0), then f = 0 
a.e. on A. 7 


Proof. We prove only some of the above, leaving the rest to the reader. 
(a) This following by Corollary 1(iv) in §4. 
(b) Use (a) and Corollary 1(v) in §4. 
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(c) First, let 
f>g>0onA. 


Take any elementary and nonnegative map H > f on A. Then H > g as 
well; so by definition, 


fare PF 
fssha 


for any such H. Hence also 


Fs cae. 
[refs 


Thus 


Similarly, 


if f>g>0. 
In the general case, f > g implies 


ft >g* and f~ <g-. (Why?) 


Thus by what was proved above, 


Tes]em [rele 


Hence 


Similarly, one obtains 


(d) It is clear that (c) implies (d). 


(e) Let 0 < p < o and suppose f > 0 on A. Take any elementary and 
nonnegative map 


h>fonA. 
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By Corollary 1(vii) and Note 3 of §4, 


A A 


[ vtaint [ on=inty [r= nf 
[tee] t 


The general case reduces to the case f > 0 by formula (1). 


Similarly, 


(e’) Assertion (e’) follows from (1) since 
(fr=f, (AU =sf, 
and —(4# — y) =y-— aif x —y is orthodox. (Why?) 
(f) Take any elementary and nonnegative map 
he f 2 Von A. 


By Corollary 1(ii) and Note 3 of §4, 


| h> | h 
B A 
for any such h. Hence 


[faint fasine [n= fie 


(g) This follows from (c) and (e’) since +f < |f| implies 


Similarly for |. 


fine frefs 
fuse f coe-f Pe -f 5 


For (h) and later work, we need the following lemmas. 


and 
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Lemma 1. Let f: S— E* and AE M. Then the following are true. 


(i) If 
| f<qek, 
A 
there is an elementary and (extended) real map 
h>f onA, 
with 
ii h<q. 
A 
(ii) If 
| f>pek, 
A 
there is an elementary and (extended) real map 
gf on, 
with 


ee 
A 


moreover, g can be made elementary and nonnegative if f >0 on A. 


Proof. If f > 0, this is immediate by Definition 1 and the properties of glb 
and lub. 
If, however, f # 0, and if 


de) aa) F 


00 > i ft. (Why?) 
A 


Thus there are u,v € E* such that g=u+v and 


our conventions yield 


0< f pt<u<oo 
A 


-f f<». 


To see why this is so, choose u so close to a A f* that 


pee, i 


and 
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and set v = q— u. 
As the lemma holds for positive functions, we find elementary and nonneg- 
ative maps h’ and h”, with 


Woof h sf, 


[b<us<coand fn" >-v. 
A A 


Let h = h’ —h”. Then 
h>fr-fo=s, 
and by Problem 6 in 84, 


[r= fue fv (tor fn is finite). 
A A A A 


[r>ute=a 
A 


and clause (i) is proved in full. 
Clause (ii) follows from (i) by Theorem 1(e’) if 


[ f<o. 


(Verify!) For the case [ ‘4 f = 0c, see Problem 3. 


Hence 


Note 3. The preceding lemma shows that formulas (1’) and (1’’) hold (and 
might be used as definitions) even for sign-changing f, g, and h. 


Lemma 2. If f: S — E* and A € M, there are M-measurable maps g and 
h, with 
g9<f<honA, 


i-LomLi-Ls 


We can take g,h>O0 if f>0 on A. 


Proof. If 22 
| J5e 
A 


the constant map h = oo satisfies the statement of the theorem. 
If 


such that 


-oo< f f<o, 


A 
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let 


f il 
m= f ir ee ee eee 
A n 


n— f F< Gn: 
A 


By Lemma 1, for each n there is an elementary and (extended) real (hence 
measurable) map h, > f on A, with 


Qn = [iv > fs 


h=infhy > f. 


sO 


Let 


By Lemma 1 in §2, h is M-measurable on A. Also, 


(Vn) i> fiin> f refs 


by Theorem 1(c). Hence 


Ju] 


the same proof works with g, = —n. (Verify!) 
Similarly, one finds a measurable map g < f, with 


ine 


Proof of Theorem 1(h). If f > 0, choose h > f as in Lemma 2. Let 


sO 


as required. 
Finally, if 


D = A(h>0) and Ay = A(h > ~); 


sO 
oe) 


n= U An (why?), 


n=1 
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and D, A, € M by Theorem 1 of §2. Also, 


v= [y=] p2 |, ()=tenen 


Thus (Vn) mA, = 0. Hence 


mp =m U A, = ™mA(h > 0) = 0; 

n=1 
so0<f<h<0 (ie, f =0) ae. on A. 
The case f < 0 reduces to (—f) > 0. 


Corollary 1. [f 


[ lel <0. 


then |f| < co a.e. on A, and A(f #0) is o-finite. 


Proof. By Lemma 1, fix an elementary and nonnegative h > |f| with 


[r<e 
A 


(so h is elementary and integrable). 
Now, by Corollary 1(i)—(iii) in §4, our assertions apply to h, hence certainly 
to f. 


Theorem 2 (additivity). Given f: S — E* and an M-partition P = {B,} 
of AE M, we have 


(2) (a) [eed]! ond (») | fer / wf 


provided 


Vs ¢ f, respectively) 
iA 


is orthodox, or P is finite. 
Hence if f is integrable on each of finitely many disjoint M-sets By, it is 


sO On 
A=\| | By: 


and formulas (2)(a)(b) apply. 


“It suffices that f be integrable on A (apply the same proof to f+ and f~). 
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Proof. Assume first f >0 on A. Then by Theorem 1(f), if one of 


so is ie ,/, and all is trivial. Thus assume all [,, f are finite. 
Then for any « > 0 andn € N, there is an elementary and nonnegative map 


hyn > f on By, with 
| hn <| fie 
Bn Bn 2 


(Why?) Now define h: A — E* by h=h, on By, n =1,2,.... 
Clearly, h is elementary and nonnegative on each B,,, hence on A (Corollary 3 
in §1), and h > f on A. Thus by Theorem 1 of 84, 


[fs fraX fi msde) cy] tte 


Making ¢ — 0, we get 
To prove also 


take any elementary and nonnegative map H > f on A. Then again, 


fue fowec]s 


As this holds for any such H, we also have 


This proves formula (a) for f > 0. The proof of (b) is quite similar. 


If f #0, we have _ _ 
Loe) ae 


where by the first part of the proof, 


LP re 
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ip 


is orthodox, one of these sums must be finite, and so their difference may be 
rearranged to yield 


eS a es on ee 


proving (a). Similarly for (b). 


A 


This rearrangement works also if P is finite (i.e., the sums have a finite 
number of terms). For, then, all reduces to commutativity and associativity of 
addition, and our conventions (2*) of Chapter 4, §4. Thus all is proved. 


Corollary 2. [fmQ=0 (Qe M), then for Ac M 


Tats ond f taf ft 


For by Theorem 2, 


ie = Toad 7 pat 


where 


by Theorem 1(b). 
Corollary 3. If 


is orthodox, so is 


whenever AD X, X © M. 


For if — =, 
Ta eel (ee) f~ is finite, 
A A JN, he 


it remains so also when A is reduced to X (see Theorem 1(f)). Hence orthodoxy 
follows by formula (1). 
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Note 4. Given f: S — E*, we can define two additive (by Theorem 2) set 
functions 5 and s by setting for X € M 


sx=f fandsx= [ Fe 
4 


They are called, respectively, the upper and lower indefinite integrals of f, also 
denoted by 

il f and / f 
(or Sf and s,). 


By Theorem 2 and Corollary 3, if 


Is 


is orthodox, then 3 is o-additive (and semifinite) when restricted to M-sets 
X CA. Also, 
30 = sd = 0 


by Theorem 1(b). 

Such set functions are called signed measures (see Chapter 7, $11). In par- 
ticular, if f > 0 on S, 5 and s are o-additive and nonnegative on all of M, 
hence measures on M. 


Theorem 3. If f: S — E* is m-measurable (Definition 2 in §3) on A, then 


Fak 


Proof. First, let f > 0 on A. By Corollary 2, we may assume that f is 
M-measurable on A (drop a set of measure zero). Now fix € > 0. 
Let Ap = A(f = 0), Aw = A(f = 00), and 


A, =A((l+e)"<f<(l+e)"t"), n=0,+£1,+2,.... 


Clearly, these are disjoint M-sets (Theorem 1 of §2), and 


A= Ap U Ag U v An. 


n=—0o 
Thus, setting 
0 on Ao, 
g=< @w on Ax, and 
(-+e)” on Ay (v—0,41,42,..2) 


264 Chapter 8. Measurable Functions. Integration 


and 


h=(1+e)gon A, 
we obtain two elementary and nonnegative maps, with 


g<f<honA. (Why?) 


fe-Ls 


By Note 1, 


Now, if {, 9 = 00, then 


yields 


If, however, |, g < oo, then 


[r= fatee=a+8 f 9 < 00% 


so g and h are elementary and integrable on A. Thus by Theorem 2(ii) in §4, 


[u- fa fa-a= [a+es-9=e fs. 


Moreover, g < f < h implies 


fosfissfits fm 
HL e-Lals fo feselo 


As € is arbitrary, all is proved for f > 0. 
The case f # 0 now follows by formula (1), since f* and f~ are M- 
measurable (Theorem 2 in §2). 


sO 
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Problems on Integration of Extended-Real Functions 
1. Using the formulas in (1) and our conventions, verify that 
(i) [xf = +00 iff f ft = 00; 
(ii) Jjf= oro iff f ft = po; and 
(iii) ff =—co iff ff = 00 and daf <e, 
(iv) Derive a condition similar to (iii) for af , f =-oo. 
) 


(v) Review Problem 6 of Chapter 4, §4. 


2. Fill in the missing proof details in Theorems 1 to 3 and Lemmas 1 and 2. 


3. Prove that if [ y f =o, there is an elementary and (extended) real map 
g<f oA, with f,g =o. 
[Outline: By Problem 1, we have 


As Lemmas 1 and 2 surely hold for nonnegative functions, fix a measurable F < f+ 


(F > 0), with 
fen L pom 


Arguing as in Theorem 3, find an elementary and nonnegative map g < F, with 


ate) fo= f F=0; 


so f,g=coand0<g<F<ftonA. 
Let 
A, = A(F>0)EM 


and 
Ap = A(F=0)EM 


(Theorem 1 in §2). On Ay, 


while on Ag, g = F =0; so 


[9 [,9= 2 oon 


Now redefine g = —oo on Ag (only). Show that g is then the required function.] 
4. For any f: S — E*, prove the following. 
(a) If ff < oo, then f < co ae. on A. 
(b) If ia is orthodox and > —oo, then f > —oo a.e. on A. 
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[Hint: Use Problem 1 and apply Corollary 1 to f+; thus prove (a). Then for (b), use 
Theorem 1(e’).] 


=>5. For any f,g: S — E*, prove that 
() Jaf t+ Sag 2 Saf +9), and 
(ii) LF +9) 2 yd edo if 9 < 00. 


[Hint: Suppose that 
Tae] e<Tyeen 


u>f fandv> [ g; 
A A 


utusf (+9). 


Then there are numbers 
with 


(Why?) Thus Lemma 1 yields elementary and (extended) real maps F > f and 


G > g such that _ _ 
u>f Pandv> [ G. 
A A 


As f+g9< F+Gon A, Theorem l(c) of §5 and Problem 6 of §4 show that 


[tos fwro=f rt fa<ute, 


contrary to 


utus i (f +9). 
A 
Similarly prove clause (ii).] 


6. Continuing Problem 5, prove that 


[groan] er fie2faroz fp refs 


provided gl 200. 


[Hint for the second inequality: We may assume that 


/ (f+9)<coand ff > co. 
A A 
(Why?) Apply Problems 5 and 4(a) to 


[ t+a+Ca. 
Use Theorem 1(e’).] 


7. Prove the following. 
(i) Lalfl <0 iff-oo< f fs Jaf <oo. 
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(ii) If Salfl < oo and J algl < oo, then 


Hf t-fias [ena 
fe-fs < | ital 


[Hint: Use Problems 5 and 6.] 
8. Show that any signed measure 3 (Note 4) is the difference of two mea- 
sures: Sf = Sf4 — Sf_. 


and 


86. Integrable Functions. Convergence Theorems 


I. Some important theorems apply to integrable functions. 


Theorem 1 (linearity of the integral). If f,g: S — E* are integrable on a set 
AEM in (S,M,m), so is 
pf +49 


for any p,q € E', and 


[wr+an) = pf traf o 
[geo- [re [io 


Proof. By Problem 5 in §5, 


[itfgzf oraz | uroz f rrp s 
ToLedom] 


are finite by integrability; so all is orthodox.) 


As _ _ 
[if se fis-f 9 


in particular, 


(Here 
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the inequalities turn into equalities, so that 


[t+ fo=furoef oro. 


Using also Theorem 1(e)(e’) from §5, we obtain the desired result for any 
p,q € E'. 


Theorem 2. A function f: S > E* is integrable on A in (S,M,m) iff 


(i) it is m-measurable on A, and 
(ii) Tek (equivalently Salf) is finite. 


Proof. If these conditions hold, f is integrable on A by Theorem 3 of §5. 


Conversely, let = 
[taf 74 0. 
A LA 


Using Lemma 2 in 85, fix measurable maps g and h (g < f < h) on A, with 


[a= [tq [ne seo. 


By Theorem 3 in 85, g and hf are integrable on A; so by Theorem 1, 


[o-a= [a- f amo. 


As 


we get 


[@-n=o 


and so by Theorem 1(h) of 85, h — f =0 ae. on A. 
Hence f is almost measurable on A, and 


[ f #400 


by assumption. From formula (1), we then get 


[pana for < 00, 
fisiqfateto= fate fF <c 


by Theorem 1 and by Theorem 2 of §2. Thus all is proved. 


and hence 
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Simultaneously, we also obtain the following corollary. 
Corollary 1. A function f: S — E* is integrable on A iff f* and f~ are. 
Corollary 2. If f,g: S — E* are integrable on A, so also are 


fV 9, fA, \fl, and kf fork ¢ E', 


‘| p= a ie 
A A 
Exercise! 


For products fg, this holds if f or g is bounded. In fact, we have the following 
theorem. 


with 


Theorem 3 (weighted law of the mean). Let f be m-measurable and bounded 
on A. Set 


p = inf f[A] and q=sup f[A]. 
Then if g is m-integrable on A, so is fg, and 


[ tll=e f tal 
for some c € |p, q]. 


If, further, f also has the Darboux property on A (Chapter 4, §9), then 
c= f(xo0) for some xp € A. 


Proof. By assumption, 
JkeE') |fl<k 


“——~ 
u 


on A. Hence it [ \g| = 0, 


: fslal) sf ital sf al =o; 


so any c € [p,q] yields 
[ fief I=. 
A A 


If, however, |, |g| 4 0, the number 


c= (/ rial) / ff l9| 
A A 
is the required constant. 


Moreover, as f and g are m-measurable on A, so is fg; and as 


[19] sla f lal <0, 
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fg is integrable on A by Theorem 2. 
Finally, if f has the Darboux property and if p < c < q (with p,q as above), 
then 


f(x) <e< fly) 


for some x,y € A (why?); hence by the Darboux property, f(x) = c for some 
ro CA. 


If, however, 
ce < inf f[A] =p, 
then 
(f —c)|g| 2 0 
and 


[t-olal =f tlal-e f lol =0 conv?) 


so by Theorem 1(h) in §5, f—-c=Oa.e. on A. Then surely f(xo) = c for some 
xo € A (except the trivial case mA = 0). This also implies c € f[A] € [p, q]. 
Proceed similarly in the case c > q. 


Corollary 3. If f is integrable on AE M, it is so onanyBCA(BEeEM). 
Proof. Apply Theorem 1(f) in §5, and Theorem 3 of 85, to f* and f~. 


II. Convergence Theorems. If f,, — f on A (pointwise, a.e., or uniformly), 


does it follow that 
[nofr 
A A 


To give some answers, we need a lemma. 


Lemma 1. /f f >0 on AE M and if 


[ f>vek 
2A 


there is an elementary and nonnegative map g on A such that 


fics 
A 


and g < f on A except only at those x € A (if any) at which 


f(x) = g(x) = 0. 
(We then briefly write g C f on A.) 
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Proof. By Lemma 1 in §5, there is an elementary and nonnegative map G < f 


on A, with 
[ rz [err 
JA A 


For the rest, proceed as in Problem 7 of §4, replacing f by G there. 


Theorem 4 (monotone convergence). [f0< fr 7 f (a.e.) on AE M, i.€., 


O< Fn = fn+1 (Vn), 
and f, — f (a.e.) on A, then 


ToT 


Proof for M-measurable f, and f on A.' By Corollary 2 in §5, we may 
assume that f, 7 f (pointwise) on A (otherwise, drop a null set). 
By Theorem 1(c) of 85,0 < f, 7 f implies 


o< fms ff 


lim tng / re 
The limit, call it p, exists in E*, as {[, fn}t. It remains to show that 


and so 


pe f saps 
[ef 


by the assumed measurability of f; see Theorem 3 in §5.) 


[ foe 


(We know that 


Suppose 


Then Lemma 1 yields an elementary and nonnegative map g C f on A, with 


e 
A 


Let 


! For the general case, see Problem 5. 
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Then A, € M and 


An 7 A= L) An 


n=l 


For if f(z) = 0, then x € Aj, and if f(z) > 0, then f(x) > g(x), so that 
fn(x) > g(x) for large n; hence x € Ay. 

By Note 4 in §5, the set function s = [ g is a measure, hence continuous by 
Theorem 2 in Chapter 7, 84. Thus 


[o=s4- lim sA, = lim g. 
A n— co 


n—- oo A 
ie 


But as g < fr, on Ay, we have 


[ssf ms | te 
[io=tim fo stim f fa=p, 


contrary to p< [ ag. This contradiction completes the proof. 


Hence 


Lemma 2 (Fatou). Jf f, >0 on AEM (n=1,2,...), then 


fim < tim J fo 


Gn = int fre n=1,2,...; 


Proof. Let 


so fn > Gn > 0 and {g,}T on A. Thus by Theorem 4, 
/ lim gn =tim f In = lim f gn < im f Tn: 
A A a A SJ A 


him: 9, = sipo, = sup inf f, = lm j,,. 
n n k2>n a 


n—- oo 


/ lim fy = f limgy < tim | Fins 
A A A 


But 


Hence 


as claimed. 
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Theorem 5 (dominated convergence). Let f,: S — E be m-measurable on 
AEM (n=1,2,...). Let 


fn — f (a.e.) on A. 
Then 
A 


n— oo 


provided that there is a map g: S — E' such that 
[<0 
A 


(Vn) |fnl<g ae. on A. 


and 


Proof. Neglecting null sets, we may assume that 
Ifnl Sg < 00 
on A and f, — f (pointwise) on A; so |f| < g and 
lfn — fl S| fal +f] < 29 


on A. As |f| < 00, we have 
lfn — fl 0 
on A. Hence, setting 
hn = 29 —|fn — f| 29, 
we get 
2g = jim, Pog = Tig: 


We may also assume that g is measurable on A. (If not, replace it by a mea- 


surable G > g, with 
/ c= | g<o, 
A A 


hn = 2g —|fn-f| 


by Lemma 2 in §5.) Then all 


are measurable (even integrable) on A. 
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Thus by Lemma 2, 


[o20= f tim < tim f 29 ~ fn £0 
=tim( f 20+ f (ls -10) 
= f 29+1m(- f if - +1) 
= | 29—Tim f If — ft 


(See Problems 5 and 8 in Chapter 2, §13.) 
Canceling { , 29 (finite!), we have 


0<—Tim ff, — fi 


Hence 


o> tim f |f,— #12 im f [fa — £120, 


as |fn — f| > 0. This yields 


o=Tim ffm fl=tim f |fn—f1=tim f [fm — ft 


as required. 


Note 1. Theorem 5 holds also for complex and vector-valued functions (for 
\fn — f| is real). 


In the extended-real case, Theorems 1(g) in §5 and Theorems 1 and 2 in §6 


yield 
[ t-fal-|[e-a]s fim-s-0, 
fon-fs 


Moreover, f is integrable on A, being measurable (why?), with 


[isis fia<e. 


For complex and vector-valued functions, this will follow from §7. Observe that 
Theorem 5, unlike Theorem 4, requires the m-measurability of the fy. 


1.€., 
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Note 2. Theorem 5 fails if there is no “dominating” 


g= ial with fg <co, 
A 


even if f and the f,, are integrable. 
Example. 


Let m be Lebesgue measure in A = E!, f = 0, and 
1 on [n,n +1], 
fn _ { 


Q elsewhere. 


Then f, > f and J, fn = 1; 80 


li a= = : 
Jim, f,io=14o= fs 


The trouble is that any 


Gof, Wea 12...) 


would have to be > 1 on B = [1, 00); so 


[oz [g=1-mp = oO, 


instead of [, g < co. 
This example also shows that f, — f alone does not imply 


Leys 


Theorem 6 (absolute continuity of the integral). Given f: S > E with 


| Mise 


and € > 0, there is 6 > 0 such that 


[its 


mx <6 (ADX, X EM). 


whenever 


Proof. By Lemma 2 in 85, fix h > |f|, measurable on A, with 


[=f lti<~. 


275 
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Neglecting a null set, we assume that |h| < oo on A (Corollary 1 of §5). Now, 
(Vn) set 


h(x), cE A,=A(h<n), 
In(x) = 
0, xe —Ap. 


Then gy, <n and g, is measurable on A. (Why?) 
Also, gn > 0 and gn — h (pointwise) on A. 


For let ¢ > 0, fix x € A, and find k > h(x). Then 
(Vn =k) A(z) <n and g,(2) = hz). 


So 
(Vn>k) |on(x) —A(x)| =0<e. 


Clearly, gn < h. Hence by Theorem 5 


Thus we can fix n so large that 


[e-a0) < ae 


For that n, let 


and take any X C A(X € M), with mX <0. 
As gn <n (see above), Theorem 1(c) in §5 yields 


1 
Joms f (=m mx <nd = Fe 
xX xX 2 


Hence as |f| < h and 


1 
| (h — gn) < f (han) * 5° 
x A 
(Theorem 1(f) of §5), we obtain 


J lis [= [ean f on < Fe 5026 


as required. 
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Problems on Integrability and Convergence Theorems 


1. Fill in the missing details in the proofs of this section. 


2. (i) Show that if f: S — E* is bounded and m-measurable on A, with 
mA < oo, then f is m-integrable on A (Theorem 2) and 


[teema, 


where inf f[A] < c < sup f[A]. 
(ii) Prove that if f also has the Darboux property on A, then 
(Arp € A) c= f (xo). 


[Hint: Take g = 1 in Theorem 3.] 


(iii) What results if A = [a,b] and m = Lebesgue measure? 


3. Prove Theorem 4 assuming that the f, are measurable on A and that 


(Sk) [ te>-0 


instead of f, > 0. 
[Hint: As {fn}, show that 


(Vn >k) ,) fn > —00. 
A 


If 
@n) ff fr=0o, 
A 
then 
i: flim f fn =~. 
A A 
Otherwise, 


< OO; 


wah) |f fn 


so fn is integrable. (Why?) By Corollary 1 in §5, assume |fn| < oo. (Why?) Apply 
Theorem 4 to hn = fn — fe (n > k), considering two cases: 


f<coand fh = 00) 
A A 


4. Show that if f, 7 f (pointwise) on A € M, there are M-measurable 
maps F,, > f, and F > f on A, with F,, 7 F (pointwise) on A, such 


that = = 
[r=] som [-]. 
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[Hint: By Lemma 2 of 85, fix measurable maps h > f and hn > fn with the same 


integrals. Let 
F, = inf (hAhx), n=1,2,..., 
k>n 


and F' = sup, Fn, < h. (Why?) Proceed.] 


5. For A € M and any (even nonmeasurable) functions f, f,: S > E*, 
prove the following. 


(i) If fn 7 f (ae.) on A, then 


Jers 


(An) [ be > —oo. 
(ii) If fn \ f (a.e.) on A, then 


[orf s 


(An) / I eS: 


A 


provided 


provided 


[Hint: Replace f, fn by F, Fp as in Problem 4. Then apply Problem 3 to F;,; thus 
obtain (i). For (ii), use (i) and Theorem 1(e’) in §5. (All is orthodox; why?)] 


6. Show by examples that 


(i) the conditions 


| n>-~ and | fn < © 
YA 


in Problem 5 are essential; and 
(ii) Problem 5(i) fails for lower integrals. What about 5(ii)? 


(Hints: (i) Let A = (0,1) C E!, m = Lebesgue measure, fn = —oo on (0, +), fn =1 
elsewhere. 

(ii) Let M = {E!,0}, mE! = 1, m@ =0, fn = 1 0n (—n,n), fn = 0 elsewhere. 
If f =1on A= E!, then fy, — f, but not 


oa, 
Explain!] 


7. Given f,: S > E* and Ae M, let 


Gq = int fpand hb, sup st, (e=1,2).<x). 
k>n k>n 
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Prove that 
(i) faim fi < lim fy fr provided (Sn) ie > —oo; and 


(ii) J, tim fn < lim f fn provided (An) J bin < OO. 
[Hint: Apply Problem 5 to gn and hn.| 


(iii) Give examples for which 


f iimh Aim ff and / lim fp ATi [ fe 
JA IA 
(See Note 2). 


8. Let f, >0on AE M and f, —- f (ae.) on A. Let AD X, X EM. 
Prove the following. 
[ no f t<o, 
A A 


(i) If 
oe 


(ii) This fails for sign-changing fn. 


then 


[Hints: If (i) fails, then 

lim f fa< f for lim [ fa > f di 

a. x I xX x 
Find a subsequence of 

mT ant} 
x A-X 
contradicting Lemma 2. 
(ii) Let m = Lebesgue measure; A = (0,1), X = (0, 3), 


f= n on (an) 


—n on (1 ay71).] 


=>9. (i) Show that if f and g are m-measurable and nonnegative on A, then 


(Va,b > 0) [orrm=af reo fo. 


(ii) If, in adeno’ Jaf <o or 4g < oo, this formula holds for any 
abe Ek’. 


[Hint: Proceed as in Theorem 1.] 
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=> 10. If 


11. 


12. 


=e 
n=1 


with all f, measurable and nonnegative on A, then 


fed Le 


[Hint: Apply Theorem 4 to the maps 


=e 


k=1 
Use Problem 9.] 
If 


0=) [lini soo 


and the f, are m-measurable on A, then 


3 lfn| < 00 (a.e.) on A 


n=1 


and f = >, fn is m-integrable on A, with 


fe-X 


[Hint: Let g = 0°°_, |fn|. By Problem 10, 


[9=% finl=a<c 


. Integration 


so g < oo (a.e.) on A. (Why?) Apply Theorem 5 and Note 1 to the maps 


nm 
In = we 
k=1 


note that |gn| < g.] 


(Convergence in measure; see Problem 11(ii) of §3). 


(i) Prove Riesz’ theorem: If f, — f in measure on A C S, there is a 
subsequence {f,,} such that f,, — f (almost uniformly), hence 


(a.e.), on A. 
[Outline: Taking 
On = On = Dek. 
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pick, step by step, naturals 
ny <N2<s+ S NE <e 
and sets Dy € M such that (Vk) 
mD, < 27* 


and 
6 Greati<2* 


on A— Dx. (Explain!) Let 


mEn <2!-". (Why?) Show that 
(Vn) (Vk >n) pl(fngr f) < 2°” 
on A— En. Use Problem 11 in §3.] 
(ii) For maps f,: S — E and g: S — E! deduce that if 
tn — f 
in measure on A and 
(Vn) |fnl Sg (ae.) on A, 


then 
lf| <g (a.e.) on A. 


(Hint: fn, — f (a.e.) on A] 
13. Continuing Problem 12(ii), let 
tn > f 
in measure on AE M (f,: S — E) and 
(Vn) |fnl <g (a.e.) on A, 


with _ 
Tes, 
A 
Prove that _ 
fits / ie 8. 
l— CO A 
Does 


282 Chapter 8. Measurable Functions. Integration 
[Outline: From Corollary 1 of §5, infer that g = 0 on A —C, where 
C= LU) Cx, (disjoint), 
k=1 
mC, < oo. (We may assume g M-measurable on A. Why?) Also, 


vo> f o= / g+ f g=04 [os 
A =C Cc a Cr 


so the series converges. Hence 


(Ve > 0) (Ap) fe-e<v fe a= | 9 


where 


and mH < oo. As |fn — f| < 2g (a.e.), we get 


(1) [ lm-sis f lima f Mest f a< f lin fl42e 


(Explain!) 
As mH < oo, we can fix o > 0 with 


o-mH <e. 


2] g<e 
x 


whenever AD X, X € M and mX <6. 
As fn — f in measure on H, we find M-sets Dy, C H such that 


Also, by Theorem 6, fix 6 such that 


(Vn >no) mDn <6 


and 
lfn — f|< oon An =H — Dn. 


(We may use the standard metric, as |f| and |fn| < oo a.e. Why?) Thus from (1), 


we get _ _ 
f \im—sis fle —s1+26 

=f Manat f a-sl426 
<f lte- F486 


for n > no. (Explain!) Hence 
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See also Problem 7 in §5 and Note 1 of §6 (for measurable functions) as regards 


lim I, fn] 


14. Do Problem 12 in §3 (Lebesgue—Egorov theorems) for T = E, assuming 
(Vn) |fn| <g (a.e.) on A, 


ee 
A 
(instead of mA < co). 

[Hint: With H;(k) as before, it suffices that 


with 


lim m(A — H;(k)) = 0. 


(Why?) Verify that 
(Vn) p'(fn,f) =|fn — f| < 2g (ae.) on A, 
and 


(Vi,k) A—Hi(k) C A(2g > =) UQ (mQ = 0). 


Infer that 
(Vi,k) m(A— Hi(k)) < oo. 


Now, as (Vk) Hi(k) \. 0 (why?), right continuity applies.] 


87. Integration of Complex and Vector-Valued Functions 


I. First we consider functions f: S — E”"(C”). For such functions, it is 
natural (and easy) to define integration “componentwise” as follows.! 


Definition 1. 


A function f: S — E” is said to be integrable on A € M iff its n (real) 
components, f1,.--, fn, are. In this case, we define 


(1) firs fisam= (fio f tof) = dae f te 


where the é€; are basic unit vectors (as in Chapter 3, §§1-3, Theorem 2). 


| As before, we presuppose an arbitrary (but fixed) measure space (S,M,m). 
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In particular, a complex function f is integrable on A iff its real and 
imaginary parts (fre and fim) are. Then we also say that [, f exists.? 
By (1), we have 


(2) [= (ff fool tim) =f tre +6 f fom 


If f: S + C”, we use (1), with complex components fx. 


With this definition, integration of functions f: S — E"(C”) reduces to 
that of f,: S + E'(C), and one easily obtains the same theorems as in §§4-6, 
as far as they make sense for vectors. 


Theorem 1. A function f: S — E"(C”) is integrable on A € M iff it is 
m-measurable on A and J, |f| < co. 


(Alternate definition!) 


Proof. Assume the range space is E”. 


By our definition, if f is integrable on A, then its components f; are. Thus 
by Theorem 2 and Corollary 1, both in §6, for k = 1,2,...,n, the functions 
f, and f, are m-measurable; furthermore, 


[ ff #00 and f fz # 00. 


This implies 


o> fists f te= [t+ a) = fh = 12.00. 


Since |f| is m-measurable by Problem 14 in §3 (|-| is a continuous mapping 
from E” to E'), and 


File 


n nm n 
> an fe| < >_ lenl fel = >_ | fal, 
k=1 k=1 k=1 


we get 


fis [Din=> [isl <o. 


Conversely, if f satisfies 
J lil<- 
A 


[ih 


? For vector-valued functions, too, this phrase means integrability. 


then 


(Vk) = Oo: 
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Also, the f; are m-measurable if f is (see Problem 2 in §3). Hence the f; are 
integrable on A (by Theorem 2 of §6), and so is f. 
The proof for C” is analogous. 


Similarly for other theorems (see Problems 1 to 4 below). We have already 
noted that Theorem 5 of 86 holds for complex and vector-valued functions. So 
does Theorem 6 in §6. We prove another such proposition (Lemma 1) below. 


II. Next we consider the general case, f: S — E (EF complete). We now adopt 
Theorem 1 as a definition. (It agrees with Definition 1 of §4. Verify!) Even 
if EF = E*, we always assume |f| < oo a.e.; thus, dropping a null set, we can 
make f finite and use the standard metric on E!. 

First, we take up the case mA < oo. 


Lemma 1. /f f, — f (uniformly) on A (mA < oo), then 


[lf s1-0 


Proof. By assumption, 


(Ve>0) (Ak) (Vn>k) |f,-—f| <e¢on A; 


sO 


(Vn > k) [lm-sis fe =e-ma<on. 


As ¢ is arbitrary, the result follows. 


Our goal is to prove results on linearity (Theorem 2) and additivity (Theo- 
rem 3) for general E; for a “limited approach,” see Problem 2 for EF = E” (C"). 


*Lemma 2. If 
; Ifl<co (mA <0) 
A 


and 
f = lim f, (uniformly) on A— Q (mQ =0) 
for some elementary maps f, on A, then all but finitely many f, are elementary 
and integrable on A, and 
lim Tn 
n—- co A 


exists in E; further, the latter limit does not depend on the sequence { f,}-. 


Proof. By Lemma 1, 


(Ve > 0) (Aq) (Wn, k > q) [i lfe-si<eand f Ife- fl <e. 
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(The latter can be achieved since 
jim f \te fel = f Mm - fl< 23) 


Now, as 
fn <|fn— fl +lfl, 
Problem 7 in 85 yields 


wn>k) fins fltm-sltf ii<et f ii<o. 


Thus f,, is elementary and integrable for n > k, as claimed. Also, by Theorem 2 
and Corollary 1(ii), both in 84, 
=| [ (n= fe 
A 


[m- ft 


Thus {[, fn} is a Cauchy sequence. As E is complete, 


(Vn, k > q) 


< [ \m-hl<e 


tim ff, # +00 


exists in E, as asserted. 
Finally, suppose g, — f (uniformly) on A — Q for some other elementary 
and integrable maps gn. By what was shown above, lim {', gn exists, and 


tim | a, -tim ff, tin | (an — fn) 


by Lemma 1, as gn — fn — 0 (uniformly) on A. Thus 
tim f In = tim f Tis 
A A 


This leads us to the following definition. 
“Definition 2. 
If f: S — E is integrable on A € M (mA < ov), we set 


[tq [tam = jim ft 


for any elementary and integrable maps f,, such that f, — f (uniformly) 
on A—Q, mQ = 0. 


sim f gn — fx ~0|=0 
A 


and all is proved. 


3 Indeed, fn — fr — fn — f (uniformly) on A as k — 00; so Lemma 1 applies. 
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Indeed, such maps exist by Theorem 3 of §1, and Lemma 2 excludes ambi- 
guity. 

“Note 1. If f itself is elementary and integrable, Definition 2 agrees with 
that of §4. For, choosing f, = f (n =1,2,...), we get 


[t=] te 


*Note 2. We may neglect sets on which f = 0, along with null sets. For 
if f =O0on A—B (ADB, BE M), we may choose f, = 0 on A— B in 


Definition 2. Then 
[fe im f t= iim f he 
A A B B 


[t= fs 


even if mA = oo, provided f = 0 on A — B, ie., 
f=fCponA 
(Cg = characteristic function of B), with AD B, Be M, and mB < ow. 
If such a B exists, we say that f has m-finite support in A. 
*Note 3. By Corollary 1 in §5, 


[ lfi<e 


implies that A(f 4 0) is o-finite. Neglecting A(f = 0), we may assume that 


(the latter as in §4). 


Thus we now define 


A= tJ) Bre mBn < 00, and {B,}t 


(if not, replace B,, by U;_, Br); so Bn 7 A. 


*Lemma 3. Let ¢: S > E be integrable on A. Let By, 7 A, MByn < o, 
and set 


fn FOC RB, a ieee 
Then fn — ¢ (pointwise) on A, all f, are integrable on A, and 


lim fin 
n— co A 


exists in E. Furthermore, this limit does not depend on the choice of {By}. 
Proof. Fix anyx¢€ A. As B, ZA=UBn, 


(Ano) (Vn >) 2E By. 
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By assumption, f, = ¢ on B,. Thus 
(Vn >no) fn(z) = (2); 


so fn — ¢ (pointwise) on A. 
Moreover, f, = ¢Cg,, is m-measurable on A (as ¢ and Cg, are); and 


|fn| = |¢| Ca, 


[itis f 101 <ce. 


Thus all f,, are integrable on A. 
As fn =0 on A— B, (mB < ov), 


[it 


is defined. Since f, — ¢ (pointwise) and |f,| < |¢| on A, Theorem 5 in §6, 


with g = |¢|, yields 
| lm-ao. 
A 


The rest is as in Lemma 2, with our present Theorem 2 below (assuming m- 
finite support of f and g), replacing Theorem 2 of §4. Thus all is proved. 


implies 


*Definition 3. 
If 6: S — E is integrable on A € M, we set 


[om foam= jim f tr, 


with the f, as in Lemma 3 (even if ¢ has no m-finite support). 
Theorem 2 (linearity). If f,g:S — E are integrable on AE M, s0 is 


pf +4g 


for any scalars p,q. Moreover, 


[wr+a0)= pf traf o. 


Furthermore if f and g are scalar valued, p and q may be vectors in E. 


*Proof. For the moment, f,g denotes mappings with m-finite support in A. 
Integrability is clear since pf + qg is measurable on A (as f and g are), and 


Ipf + ag9| < |pIIf| + lal lal 
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yields 


[or+aslstal f ist+lal f Ial <0. 


Now, as noted above, assume that 
f =f Cp, and 9 = 9Cpz, 
for some B,, By C A (mB, + mMBz < oo). Let B = By, U By; so 
f=9=pi +qg=Von A= B; 
additionally, 


[t- fs [a= fis and [wr+as)= f ot +49). 


Also, mB < oo; so by Definition 2, 


[tim [tana [ g=iim fo, 


for some elementary and integrable maps 
fn — f (uniformly) and g, — g (uniformly) on B— Q, mQ = 0. 
Thus 
Pfn+49n > pf + 4g (uniformly) on B- Q. 
But by Theorem 2 and Corollary 1(vii), both of §4 (for elementary and inte- 


grable maps), 
| @hn+ ag) =» | fata | Jn: 
B B B 
Hence 


[os + 4g) = [ws + qg) = lim [ot + q9n) 


=tim(o f r+afio)=vf traf o=vf traf 


This proves the statement of the theorem, provided f and g have m-finite 
support in A. For the general case, we now resume the notation f,g,... for 
any functions, and extend the result to any integrable functions. 

Using Definition 3, we set 


A= U By, {Ba kl, mB < O°, 


n=1 
and 
n= Coop Gn =OCR. T= Vides 
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Then by definition, 


[t= lim Rls and [eo lim Ins 
A A A 


noo n—-oo 


pf traf o= jim (vf traf on). 


As fn, 9n have m-finite supports, the first part of the proof yields 


rf fata | on =f (Pho + a9): 
A A A 
Thus as claimed, 


pf t+af o=im | wf +400) = f wf +49). 


Similarly, one extends Corollary 1(ii)(iii)(v) of $4 first to maps with m-finite 
support, and then to all integrable maps. The other parts of that corollary 
need no new proof. (Why?) 


Theorem 3 (additivity). 
(i) If f: S > E is integrable on each of n disjoint M-sets Ax, it is so on 


their union 
n 
A=|J Az, 
k=1 


and so 


and 
f= f 
[os 
(ii) This holds for countable unions, too, if f is integrable on all of A. 


*Proof. Let f have m-finite support: f = f Cg on A, mB < oo. Then 
| f= [ f and 
A a oo 


Be=Ap NB, k=1,2,...,n 


where 


By Definition 2, fix elementary and integrable maps f; (on A) and a set Q 
(mQ = 0) such that f; — f (uniformly) on B—Q (hence also on By — Q), with 


[t= fre im ff fi and | j = im Bo” he A 2s CD 
A B 1— CO Ax 1— CO 
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As the f; are elementary and integrable, Theorem 1 in 84 yields 


[r= [ned Phay fh 


Hence 
faim | Zam pe (im, [ f) = I. 


Thus clause (i) holds for maps with m-finite support. For other functions, 
(i) now follows quite similarly, from Definition 3. (Verify!) 
As for (ii), let f be integrable on 


A= |) Ar (disjoint), A, € M. 
k=1 


In this case, set gn, = f Cz,,, where B, =U;,_, Ax, n = 1,2,.... By clause (i), 
we have 


(3) fim= fi mad fi m= fs 


since gn = f on each Ax C By. 
Also, as is easily seen, |gn| <|f| on A and g, — f (pointwise) on A (proof 
as in Lemma 3). Thus by Theorem 5 in §6, 


[m-flo 
[m- f= [toma] 5 flows 


Loa lim In; 
A n— co A 


we obtain 


and the result follows by (3). 


Problems on Integration of Complex 
and Vector- Valued Functions 


1. Prove Corollary 1(iii)-(vii) in §4 componentwise for integrable maps 
f:S— E"(C”). 
2. Prove Theorems 2 and 3 componentwise for E = E” (C”). 


2’. Do it for Corollary 3 in 86. 
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=10. 


11. 


12. 


13. 
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[ lel<co 


[ til <0, fe Ly oe gs 
A 


. Prove Theorem 1 with 


replaced by 


. Prove that if f: S — E” (C”) is integrable on A, so is | f|. Disprove the 


converse. 


. Disprove Lemma 1 for mA = oo. 

. Complete the proof of Lemma 3. 

. Complete the proof of Theorem 3. 

. Do Problem 1 and 2’ for f: S > E. 


. Prove formula (1) from definitions of Part II of this section. 


Show that 


als fu 


for integrable maps f: S — E. See also Problem 14. 
[Hint: If mA < oo, use Corollary 1(ii) of §4 and Lemma 1. If mA = co, “imitate” 
the proof of Lemma 3.| 


Do Problem 11 in 86 for f,: S — E. Do it componentwise for EF = 
BP Gr, 
Show that if f,g: S — E+ (C) are integrable on A, then 


fas} < fur foe, 


In what case does equality hold? Deduce Theorem 4(c’) in Chapter 3, 
§$1—3, from this result. 


[Hint: Argue as in that theorem. Consider the case 


— 


Ate E} —tg| = 0. 
te ) fiir tg| = 0] 


Show that if f: S$ — E'(C) is integrable on A and 


fal= fin 


daeeC) ef =|f| ae.on A. 


then 


—— 
| 


4 One may assume that f',|f|? and f, |g|? are finite (otherwise, all is trivial). 
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(Hint: Let a= f, f. The case a = 0 is trivial. If a £ 0, let 
|a| 


c= —; |c| =1; ca=|al. 
a 


Let r = (cf)re. Show that r < |cf| = |f\, 


fla ferafes fus|fe 
[i= fora [ete 


(cf)re = |cf| (a.e.), and cf = |cf| =|f| a.e. on A|] 
14. Do Problem 10 for EF = C using the method of Problem 13. 


15. Show that if f: S — E is integrable on A, it is integrable on each M-set 
BCAA. If, in addition, 
ig 
B 


for all such B, show that f = 0 a.e. on A. Prove it for E = E” first. 
[Hint for FE = E*: A= A(f >0)UA(f <0). Use Theorems 1(h) and 2 from §5.] 


16. In Problem 15, show that 
s= / a 
is a o-additive set function on 
Ma={XEM|X CA} 
(Note 4 in §5); s is called the indefinite integral of f in A. 


? 


§8. Product Measures. Iterated Integrals 
Let (X,M,m) and (Y,N,n) be measure spaces, with X € M and Y € N. Let 
C be the family of all “rectangles,” i.e., sets 

Ax B, 


with AE M, BEN, mA < 0, and nB < ow. 
Define a premeasure s: C — E! by 


s(Ax B)=mA-nB, AxBeEC. 
Let p* be the s-induced outer measure in X x Y and 
p: P* — E* 


the p*-induced measure (“product measure,” p = m X n) on the o-field P* of 
all p*-measurable sets in X x Y (Chapter 6, §85-6). 
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We consider functions f: X x Y — E* (extended-real). 


I. We begin with some definitions. 


Definitions. 


(1) Given a function f: X — Y — E* (of two variables x, y), let f,, or f(a, -) 
denote the function on Y given by 


fu (y) = faa); 


it arises from f by fixing x. 
Similarly, f¥ or f(-,y) is given by f¥(x) = f(z, y). 
(2) Define g: X — E* by 


and set 


also written 


[i amc) f fee.v) ania), 


This is called the iterated integral of f on Y and X, in this order. 
Similarly, 


hy) = [fram 


[ [ faman= [nan 


Note that by the rules of §5, these integrals are always defined. 


and 


(3) With f,g,h as above, we say that f is a Fubini map or has the Fubini 
properties (after the mathematician Fubini) iff 


(a) g is m-measurable on X and h is n-measurable on Y; 


(b) fe is n-measurable on Y for almost all x (ie., for x € X — Q, 
mQ = 0); f¥ is m-measurable on X for y € Y — Q’, nQ’ = 0; and 


(c) the iterated integrals above satisfy 


[ [ fenam= fof taman= fo tap 


(the main point). 
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For monotone sequences 
fpr: X XY oe (k= 1,2,..:), 
we now obtain the following lemma. 


Lemma 1. /f0 < f, 7 f (pointwise) on X x Y and if each fy has Fubini 
property (a), (b), or (c), then f has the same property. 


Proof. For k = 1,2,..., set 


gn (c) = [hele dn 
and 


he(y) = | fel. 


By assumption, 
pointwise on Y. Thus by Theorem 4 in §6, 


[feed f fear, 


i.e., gk “ g (pointwise) on X, with g as in Definition 2. 
Again, by Theorem 4 of 86, 


[nam f gam: 
xX xX 


[ [ fanam = jim ffl fednam. 
[ [ faman 


[ te. 
xXxxXY 
Hence f satisfies (c) if all f, do. 
Next, let f;, have property (b); so (Vk) f,(x,-) is n-measurable on Y if 
xe xX —Qz (MQ, = 0). Let 


or by Definition 2, 


Similarly for 


and 


O= |) Qu 
k=1 
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so mQ = 0, and all f,(x,-) are n-measurable on Y, for c € X — Q. Hence 
so is 


f(a, -) = Jim fale, +). 


Similarly for f(-,y). Thus f satisfies (b). 
Property (a) follows from g, — g and hy — h. 


Using Problems 9 and 10 from 86, the reader will also easily verify the fol- 
lowing lemma. 


Lemma 2. 


(i) If fi and fo are nonnegative, p-measurable Fubini maps, so is afi + bf2 
fora, b> V0. 


(ii) If, in addition, 


; fidp <co or | fodp<o, 
XxY XxY 


then fi — fo is a Fubini map, too. 


Lemma 3. Let f = >°3°, fi (pointwise), with f; >0 on X x Y. 
(i) If all f; are p-measurable Fubini maps, so is f. 


(ii) If the f; have Fubini properties (a) and (b), then 


ff temam=3 ff hana 
[ fteman=X ff sedan 


II. By Theorem 4 of Chapter 7, §3, the family C (see above) is a semiring, 
being the product of two rings, 


and 


{AEM|mA< co} and {BEN |nB < oo}. 


(Verify!) Thus using Theorem 2 in Chapter 7, §6, we now show that p is an 
extension of s:C > E!. 


Theorem 1. The product premeasure s is c-additive on the semiringC. Hence 
(i) CC P* and p=s < ow onC, and 


(ii) the characteristic function Cp of any set DEC is a Fubini map. 
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Proof. Let D= Ax B€EC;so0 
Cp(x,y) = Ca(x)- Cay). 


(Why?) Thus for a fixed x, Cp(x,-) is just a multiple of the V-simple map 
Cg, hence n-measurable on Y. Also, 


g(a) = ¥: Cala, «) dn= Ca(z) - | Cpdn =Ca(zr)-nB; 
Y Y 
so g =C,4-nB is M-simple on X, with 


[ [ codnam =f gam=ne | Cadm=nB-mA= sD. 
x JY x x 


Similarly for Cp(-,y), and 


h(y) = | col-.nam. 


Thus Cp has Fubini properties (a) and (b), and for every D € C 


(1) | [ codnam= | [Cp aman = sp. 
x Jy y Jx 


To prove o-additivity, let 


D= U D;, (disjoint), D; € C; 
1=1 


Cp =>_Cp,. 
t=1 


(Why?) As shown above, each Cp, has Fubini properties (a) and (b); so by (1) 
and Lemma 3, 


=| [c dndm = [fe Cnn = SDs 
IY = > xy . > 


as required. 


sO 


Assertion (i) now follows by Theorem 2 in Chapter 7, §6. Hence 


sD=pD= Cp dp; 
AY 


so by formula (1), Cp also has Fubini property (c), and all is proved. 


Next, let P be the o-ring generated by the semiring C (soC CP C P*). 


298 Chapter 8. Measurable Functions. Integration 


Lemma 4. P is the least set family R such that 
(i) RIC; 
(ii) R is closed under countable disjoint unions; and 


(ii) H- DER ifDER and DCH, HEC. 


This is simply Theorem 3 in Chapter 7, 83, with changed notation. 
Lemma 5. If D € P (a-generated by C), then Cp is a Fubini map. 


Proof. Let R be the family of all D € P such that Cp is a Fubini map. We 
shall show that R satisfies (i)—(iii) of Lemma 4, and so P C R. 


(i) By Theorem 1, each Cp (D € C) is a Fubini map; so each D € C is in R. 
(ii) Let 


p= U D;, (disjoint), Di; €R. 
i=1 


Then 
Cp = >. Oi oe 
i=l 
and each Cp, is a Fubini map. Hence so is Cp by Lemma 3. Thus D € R, 


proving (ii). 


(iii) We must show that Cy_p is a Fubini map if Cp is and if DC H, H €C. 
Now, D C H implies 


Cy—p = Cy = Cp. 
(Why?) Also, by Theorem 1, H € C implies 
| Cydp=pH =sH < wo, 
XxXY 
and Cy is a Fubini map. So is Cp by assumption. So also is 
Cup =Cy —Cp 


by Lemma 2(ii). Thus H — D € R, proving (iii). 
By Lemma 4, then, P C R. Hence (VD € P) Cp is a Fubini map. 


We can now establish one of the main theorems, due to Fubini. 


Theorem 2 (Fubini lI). Suppose f: X x Y > E* is P—measurable on X x Y 
(P as above) rom. Then f is a Fubini map if either 


(i) f>0onXxY, or 
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fi Mle ff ltlanam, al [ [ ltlaman 


is finite. 


(ii) one of 


In both cases, 


(2) [ [fenam= fof paman= fi tap. 


Proof. First, let 
f= laCv, (a: >0, Di € P), 
i=l 


ie., f is P-elementary, hence certainly p-measurable. (Why?) By Lemmas 5 
and 2, each a;Cp, is a Fubini map. Hence so is f (Lemma 3). Formula (2) is 
simply Fubini property (c). 

Now take any P-measurable f > 0. By Lemma 2 in 82, 


f= lim frouxxyY 


for some sequence { f;,}7 of P-elementary maps, f;, > 0. As shown above, each 
f, is a Fubini map. Hence so is f by Lemma 1. This settles case (i). 


Next, assume (ii). As f is P-measurable, so are ft, f_, and |f| (Theorem 2 
in §2). As they are nonnegative, they are Fubini maps by case (i). 
So is f = ft — f~ by Lemma 2(ii), since f* < |f| implies 


| ft dp <0 
xXxxXY 


by our assumption (ii). (The three integrals are equal, as |f| is a Fubini map.) 


Thus all is proved. 


III. We now want to replace P by P* in Lemma 5 and Theorem 2. This works 
only under certain o-finiteness conditions, as shown below. 


Lemma 6. Let D € P* be o-finite, i.e., 
De U D;, (disjoint) 
i=1 
for some D; € P*, with pD; < oo (i =1,2,...).? 


' Note the use of absolute values; without them, Theorem 2 fails (see Problem 5’). 
2 See Note 2 in Chapter 7, 88. 
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Then there is a K € P such that p(k —D)=0andDCK. 
Proof. As P is a o-ring containing C, it also contains C,. Thus by Theorem 3 
of Chapter 7, 85, p* is P-regular. 

For the rest, proceed as in Theorems 1 and 2 in Chapter 7, 87. 


Lemma 7. If D € P* is a-finite (Lemma 6), then Cp is a Fubini map. 
Proof. By Lemma 6, 
(GK EP) p(K-D)=0,DCK. 


Let Q = K — D, so pQ = 0, and Cg = Cx — Cp; that is, Cp = Cx — Cg and 
| Ca dp = pQ = 0. 
XxxY 


As Kk € P, Cx is a Fubini map. Thus by Lemma 2(ii), all reduces to proving 
the same for Cg. 
Now, as pQ = 0, Q is certainly o-finite; so by Lemma 6, 


AZEP) QCZ, pZ =pQ =0. 


Again Cz is a Fubini map; so 


J [ ceanam = | Czdp=pZ =0. 
x Jy XxY 


As Q C Z, we have Cg < Cz, and so 


oe [ [fave] am 
7 cf |fcue.-) . in] dm=[ Cedp=o. 


(4) [ fcodman= [| f col-nan| dn = 0. 


Thus setting 
“=f Ce(a, -)dn and h(y =f Ca(- 


| gam=o= | nan. 
x ¥ 


Hence by Theorem 1(h) in 85, g =O a.e.on X, andh=Oae.onY. Sogandh 
are “almost” measurable (Definition 2 of §3); ie., Cg has Fubini property (a). 


we have 
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Similarly, one establishes (b), and (3) yields Fubini property (c), since 


J [ codnam= ff coaman= f Ca dp = 0, 
x JY ¥IX XxY 


as required. 


Theorem 3 (Fubini II). Suppose f: X x Y > E* is P*-measurable? on X x Y 
and satisfies condition (i) or (ii) of Theorem 2. 

Then f is a Fubini map, provided f has o-finite support, 7.e., f vanishes 
outside some o-finite set H CX x Y. 


Proof. First, let 
f=) aCp, (a, >0, De P*), 
i=1 


with f = 0 on —H (as above). 

As f =a; #0 on Aj, we must have D; C H; so all D; are o-finite. (Why?) 
Thus by Lemma 7, each Cp, is a Fubini map, and so is f. (Why?) 

If f is P*-measurable and nonnegative, and f = 0 on —H, we can proceed 
as in Theorem 2, making all fy vanish on —H. Then the f, and f are Fubini 
maps by what was shown above. 

Finally, in case (ii), f = 0 on —H implies 


ft=f- =|f|=0on-z. 


Thus ft, f~, and f are Fubini maps by part (i) and the argument of Theo- 
rem 2. 


Note 1. The o-finite support is automatic if f is p-integrable (Corollary 1 
in §5), or if p or both m and n are o-finite (see Problem 3). The condition is 
also redundant if f is P-measurable (Theorem 2; see also Problem 4). 


Note 2. By induction, our definitions and Theorems 2 and 3 extend to any 
finite number q of measure spaces 


CGM), tle 4G 


One writes 
pH=m, x ™M2 


if g = 2 and sets 


My X Mg X +++ X M41 = (My X +++ X Mg) X Mgq41- 


3 Or, equivalently, p-measurable (Note 2 in §3), as p is complete (Theorem 1 of Chap- 
ter 7, §6). 
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Theorems 2 and 3 with similar assumptions then state that the order of inte- 
grations is immaterial. 

Note 3. Lebesgue measure in E% can be treated as the product of q one- 
dimensional measures. Similarly for LS product measures (but this method is 
less general than that described in Problems 9 and 10 of Chapter 7, §9). 

IV. Theorems 2(ii) and 3(ii) hold also for functions 
f:XxY— E"(C") 


if Definitions 2 and 3 are modified as follows (so that they make sense for such 
maps): In Definition 2, set 


ate) = | frdn 


if f, is n-integrable on Y, and g(x) = 0 otherwise. Similarly for h(y). In 
Definition 3, replace “measurable” by “integrable.” 
For the proof of the theorems, apply Theorems 2(i) and 3(i) to |f|. This 


yields 
[ filtiaman= fof itianam =f Ilae, 


Hence if one of these integrals is finite, f is p-integrable on X x Y, and so are 
its g components. The result then follows on noting that f is a Fubini map 
(in the modified sense) iff its components are. (Verify!) See also Problem 12 
below. 


V. In conclusion, note that integrals of the form 


[fe (Der) 


reduce to 


| eres 
xXxxY 


Thus it suffices to consider integrals over X x Y. 


Problems on Product Measures and Fubini Theorems 
1. Prove Lemmas 2 and 3. 
1’. Show that {A € M | mA < oo} is a set ring. 
2. Fill in all proof details in Theorems 1 to 3. 


2’. Do the same for Lemmas 5 to 7. 
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3. 


5’. 
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Prove that if m and n are o-finite, so is p = mxn. Disprove the converse 


by an example. 
[Hint: (U; Ai) x (Uj By) = Uy,j(Ai x By). Verify! 


. Prove the following. 


(i) Each D € P (as in the text) is (p) o-finite. 


(ii) All P-measurable maps f: X x Y — E* have o-finite support. 


[Hints: (i) Use Problem 14(b) from Chapter 7, §3. (ii) Use (i) for P-elementary and 


nonnegative maps first.] 


(i) Find D € P* and x € X such that Cp(z, -) is not n-measurable 


on Y. Does this contradict Lemma 7? 


[Hint: Let m = n = Lebesgue measure in E!; D = {x} x Q, with Q non- 


measurable.| 


(ii) Which C-sets have nonzero measure if X = Y = E!, m 


* is as in 


Problem 2(b) of Chapter 7, §5 (with S = X), and n is Lebesgue 


measure? 


Let m = n = Lebesgue measure in [0,1] = X = Y. Let 


dL 1 
fad MEAD on (a -| and 
0 elsewhere. 
Let be 
f(2,y) = > [fe(x) — fe+r(2)] fe(y)s 
k=1 


the series converges. (Why?) Show that 

(i) (Vk) fx fe = 15 

Gi) f, f, fdwdm =140= fy [, fdmdn. 
What is wrong? Is f P-measurable? 


[Hint: Explore 
Jf ltlanam, 
xJ¥ 


n = Lebesgue measure in Y. 


. Let X = Y = (0, 1], m as in Example (c) of Chapter 7, 86, (S = X) and 


(i) Show that p = m x n is a topological measure under the standard 


metric in E?. 
(ii) Prove that D={(z,y)—€XxY|z2=y}eP*. 
(iii) Describe C. 


[Hints: (i) Any subinterval of X x Y is in P*; (ii) D is closed. Verify!] 


304 


es 


8. 


=10. 
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Continuing Problem 6, let f = Cp. 
(i) Show that 


[ [ sanam=o41= ff ramen. 


What is wrong? 
[Hint: D is not o-finite; for if 


at least one D; is uncountable and has no finite basic covering values (why?), 
so p* Di, = 0o.] 


(ii) Compute p*{(x,0)| a € X} and p*{(0,y) |ye VY}. 
Show that D € P* is o-finite iff 
DC (JD; (disjoint) 
i=1 


for some sets D; € C. 
[Hint: First let p*D < oo. Use Corollary 1 from Chapter 7, §1.] 


. Given DEP, ae X, and be Y, let od 
Da={yeY|G@yeD} pee at 
and ».| 
D? = {x € X | (x,b) € D}. | 
(See Figure 34 for X = Y = E!.) 5 : x 
Prove that peanueas 


G) Dz EN, De M: 
(ii) Cpla,.*)= Cp, 2Da= a Cp(a, -)dn, mD® = | Cp(-,b) dm. 
Y x 
[Hint: Let 
R={ZEP|Za EN}. 
Show that R is a o-ring D C. Hence R DP; DER; Da EN. Similarly for D?.] 
Let m = n = Lebesgue measure in E' = X = Y. Let f: E! = [0,00) 
be m-measurable on X. Let 
H = {(,y) € EB? |0<y< f(z)} 


and 
G= {(2,y) € E? | y= f(z,y)} 
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11. 


*12. 


(the “graph” of f). Prove that 
(i) H € P* and 


p= | fam 


(= “the area under f”); 
(ii) Ge P* and pG = 0. 


[Hints: (i) First take f = Cp, and elementary and nonnegative maps. Then use 
Lemma 2 in §2 (last clause). Fix elementary and nonnegative maps f;, 7 f, assuming 
tk < f (if not, replace f, by (1 — it) fr): Let 


Ay = {(a,y) |OSy < fa(x)}. 
Show that H, 7H € P*. 
(ii) Set 
o(z,y) =y — f(2). 
Using Corollary 4 of §1, show that ¢ is p-measurable on E?; so G = E?(¢ = 0) € P*. 
Dropping a null set (Lemma 6), assume G € P. By Problem 9(ii), 
(Va € E') me Ca(« nGz =0, 


as G, = {f(x)}, a singleton.| 
Let 
f(@,y) = o1(x) ba(y). 


Prove that if ¢; is m-integrable on X and ¢2 is n-integrable on Y, then 
f is p-integrable on X x Y and 


[farm foo [oe 


Prove Theorem 3(ii) for f: X x Y — E (E complete). 
[Outline: If f is P*-simple, use Lemma 7 above and Theorem 2 in §7. 
If 


f=) anCp,, DeeP*, 
k=1 


let 


and f;, = fCy,, so the f, are P*-simple (hence Fubini maps), and f, — f (point- 
wise) on X x Y, with |f,| <|f| and 


/ ifiap< es 
xxY 


(by assumption). Now use Theorem 5 from §6. 
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Let now f be P*-measurable; so 


= Jim fr (uniformly) 


for some P*-elementary maps g, (Theorem 3 in §1). By assumption, f = fCy (H 
o-finite); so we may assume gz = gxCy. Then as shown above, all gz are Fubini 
maps. So is f by Lemma 1 in §7 (verify!), provided H C D for some D €C. 


In the general case, by Problem 8, 
H C| JD; (disjoint), Di €C. 


v 
Let H; = HM D;. By the previous step, each fCy, is a Fubini map; so is 


k 


fre =) iCH, 


i=l 


(why?), hence so is f = jim fr, by Theorem 5 of §6. (Verify!)] 


Let m = Lebesgue measure in E!, p = Lebesgue measure in E°, X = 
(0,00), and 

Y={ye E* | |g = 1. 
Given z € E* — {0}, let 

r=|z| andu=— €Y. 


x 
- 
Call r and u the polar coordinates of z # 0. 
If D CY, set 


wDes-p irul|wedD, ere lh 


Show that n* is an outer measure in Y; so it induces a measure n in Y. 
Then prove that 


fap= f rram(r) [ straan(a) 


if f is p-measurable and nonnegative on E*. 
[Hint: Start with f= Cy, 


Es 


A={rt|uaeH, a<r< bd}, 


for some open set H C Y (subspace of £*). Next, let A € B (Borel set in Y); then 
AC P*. Then let f be p-elementary, and so on.] 
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I. In this section, C is the family of all intervals in EF”, and m is an additive 
finite premeasure on C (or C,), such as the volume function v (Chapter 7, 


§§1-2). 
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By aC-partition of A€ C (or A €C,), we mean a finite family 
P= {A;} ane 


such that 
A= U A; (disjoint). 


v7 


As we noted in §5, the Riemann integral, 


Rf F=Rf fam, 


of f: E” — E' can be defined as its Lebesgue counterpart, 


Ta 


with elementary maps replaced by simple step functions (“C-simple” maps.) 
Equivalently, one can use the following construction, due to J. G. Darboux. 


Definitions. 
(a) Given f: BE” — E* and a C-partition 
P= {Ais ciagAg} 


of A, we define the lower and upper Darboux sums, S$ and S, of f over 
P (with respect to m) by 


(1) S(f,P) = 5° mA; - inf f[Ai] and S(f,P) = 5° mA;- sup f[Ai]-1 


i=1 i=l 


(b) The lower and upper Riemann integrals (“R-integrals”) of f on A (with 
respect to m) are 


nf sar] fam=sw 30s?) and 


a f= rf f dm = inf S(f,P),? 
A A - 
where the “inf” and “sup” are taken over all C-partitions P of A. 


(c) We say that f is Riemann-integrable (“R-integrable” ) with respect to m 
on A iff f is bounded on A and 


nf s=rf is 


1,2 These expressions exist in E* (Chapter 4, §4, (2*)). 
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We then set 


af t=ef ran] fam=ef fam 


and call it the Riemann integral (“R-integral”) of f on A. “Classical” 
notation: 


R a f(®) dm(z). 


If A= [a,b] c E', we also write 


nf f= Rf se) dma) 


instead. 
If m is Lebesgue measure (or premeasure) in E', we write “dx” for 
a ced i 
For Lebesgue integrals, we replace “R” by “ZL,” or we simply omit “R.” 
If f is R-integrable on A, we also say that 


Rf 


exists (note that this implies the boundedness of f); note that 


nfs and nf 


are always defined in E*. 


Below, we always restrict f to a fixed A € C (or A € C,); P, P’, BP”, P*, 
and P, denote C-partitions of A. 


We now obtain the following result for any additive m: C — [0,0o). 


Corollary 1. Jf P refines P’ (§1), then 
SG,P') 5 SEP) = SG,P) SSP): 
Proof. Let P’ = {Ai}, P = {Bix}, and 
(vi) Ap=|J) Bu. 
k 


By additivity, 


mA; = SS MBjp. 
k 
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Also, Bj, C A; implies 
f[Bix] © f[Aal; 
sup f[Bix] < sup [Ai]; and 
inf f[Bi,] > inf f[Ai). 


So setting 
a, = inf f[A,] and b,, = inf f| Bix, 
we get 
S(f,P) = > a;ymA; = S° >. ajmBix 
i ik 
< S° bimBiyx, = S(f,P). 
i,k 
Similarly, 
SP) = 8G?) 
and 


is obvious from (1). 


Corollary 2. For any P’ and P”, 
SP) S SGP’): 


nf ssrf is 


Proof. Let P = P’N P” (see §1). As P refines both P’ and P”, Corollary 1 
yields 


Hence 


S(f,P') < SF,P) < S(f,P) < SF,P"). 


Thus, indeed, no lower sum $(f,P’) exceeds any upper sum $(f,P’). 
Hence also 
sup 5(f,P’) <inf SU, P"), 
Pp! Pr 


R i f rf if. 


Le., 


as claimed. 
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Lemma 1. A map f: A— E' is R-integrable iff f is bounded and, moreover, 


(3) (Ve>0) (GP) S(f,P)-—S(f,P) <e. 


Proof. By formulas (1) and (2), 


S(f,P) < rf pe rf f < BUf,P). 
vA 


ef 7 nf i 


nf sar] s 


Conversely, if so, definitions (b) and (c) imply the existence of P’ and P” 
such that 


Hence (3) implies 


<6. 


As ¢ is arbitrary, we get 


so f is R-integrable. 


SP )> Rf f—5e 
and 


_ 1 

SUP") < rf eg 
A 2 

Let P refine both P’ and P’”. Then by Corollary 1, 
SU, P) _ S(f, P) < S(f, P”) ~ SU;P) 


ot ace ore 


Lemma 2. Let f be C-simple; say, f = a; on A; for some C-partition P* = 
{A;} of A (we then write 
f= d jal, 


as required. 


on A; see Note 4 of 84). 
Then 


(4) Rf f=Rf f= SAP) = BLP) = Dama, 
2A 


a 


Hence any finite C-simple function is R-integrable, with Hl) f as in (A). 


89. Riemann Integration. Stieltjes Integrals 311 


Proof. Given any C-partition P = {B,,} of A, consider 
P* AP ={A;N Bg}. 
As f =a; on A;M By (even on all of A;), 
a; = inf f[A; N By] = sup f[A;N Bx. 


Also, 
A=\|J(4in Br) (disjoint) 
i,k 

and 

(Vi) Ai =|J(AiN Be); 

k 

sO 

mA; = So m(Ai N Bx) 

k 

and 


S(f,P) =>) So aim(AiN By) = 5) gm; = S(f,P*) 
4 k a 


for any such P. 
Hence also 


de aimAi = sup S(f,P) =Rf q. 


a A 


Similarly for Rf J. This proves (4). 
If, further, f is finite, it is bounded (by max |a;|) since there are only finitely 
many a;; so f is R-integrable on A, and all is proved. 


Note 1. Thus § and § are integrals of C-simple maps, and definition (b) 
can be restated: 


a fasupk | g and | faintR | h, 
JA g A A h A 


taking the sup and inf over all C-simple maps g, h with 
g<f<hona. 


(Verify by properties of glb and lub!) 

Therefore, we can now develop R-integration as in §$4—5, replacing elemen- 
tary maps by C-simple maps, with S = E”. In particular, Problem 5 in §5 
works out as before. 

Hence linearity (Theorem 1 of §6) follows, with the same proof. One also 
obtains additivity (limited to C-partitions). Moreover, the R-integrability of f 
and g implies that of fg, f Vg, f Ag, and |f|. (See the Problems.) 
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Theorem 1. If f; — f (uniformly) on A and if the f; are R-integrable on A, 
80 also is f. Moreover, 


lim Rf [f= fi] =0 and im Rf =R ff. 
1— CO A 1—Co A A 


Proof. As all f; are bounded (definition (c)), so is f, by Problem 10 of Chap- 
ter 4, §12. 
Now, given ¢ > 0, fix k& such that 


(Vi>k) |f-fil< — on A. 
Verify that 
(Vizk) (VP) |S(f—fi,P)| <e and |S(f — fi,P)] <6 

fix one such f; and choose a P such that 

SGP) Sa) <e, 
which one can do by Lemma 1. Then for this P, 

S(f,P) — S(f,P) < 3e. 
(Why?) By Lemma 1, then, f is R-integrable on A. 


Finally, 
efs-efs 
A A 


crf \t- fl 
crf (53) =ma(Ga) == 


for all i > k. Hence the second clause of our theorem follows, too. 


Corollary 3. If f: E' — E! is bounded and regulated (Chapter 5, §10) on 
A= [a,b], then f is R-integrable on A. 

In particular, this applies if f is monotone, or of bounded variation, or 
relatively continuous, or a step function, on A. 


Proof. By Lemma 2, this applies to C-simple maps. 
Now, let f be regulated (e.g., of the kind specified above). 
Then by Lemma 2 of Chapter 5, §10, 
f = lim g; (uniformly) 


1 CO 


for finite C-simple g;. 
Thus f is R-integrable on A by Theorem 1. 
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II. Henceforth, we assume that m is a measure on a o-ring M DC in E”, 
with m < co on C. (For a reader who took the “limited approach,” it is now 


time to consider §§4-6 in full.) The measure m may, but need not, be Lebesgue 
measure in £”. 


Theorem 2. Jf f: E” — E! is R-integrable on A € C, it is also Lebesgue 
integrable (with respect to m as above) on A, and 


bf s=Rf te. 


Proof. Given a C-partition P = {A;} of A, define the C-simple maps 
g= > a; Ca, andh = 5°; Ca, 


with 
a, = inf f[A;] and b; = sup f[Aj|. 


Then g < f <honA with 


SUP) = Dramas =z fg 


and 


By Theorem 1(c) in §5, 


sp)=Lf g<uf feuf pei f n=314,7). 
A JA A A 
As this holds for any P, we get 


(5) nf f=swSts.P) ctf i = bf f= inf SL) =r f. 


af f=] s 


Thus these inequalities become equations: 


aff r-f toa] s 


But by assumption, 
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Also, by definition (c), f is bounded on A; so |f| < K < oo on A. Hence 


Vale fiisx: mA <0o0.? 
[ t-[ fee 


i.e., f is Lebesgue integrable, and 
bp Gah] F, 
A A 


Note 2. The converse fails. For example, as shown in the example in 84, 
f = Cr (R = rationals) is L-integrable on A = [0,1]. 

Yet f is not R-integrable. 

For C-partitions involve intervals containing both rationals (on which f = 1) 
and irrationals (on which f = 0). Thus for any P, 


S(f,P) =0 and S(f,P) =1-mA=1. 


Thus 


as claimed. 


j =j {Ss i P = 5 


nf f=o4R] f 


Note 3. By Theorem 1, any RJ, f is also a Lebesgue integral. Thus the 
rules of 885-6 apply to R-integrals, provided that the functions involved are 
R-integrable. For a deeper study, we need a few more ideas. 


while 


Definitions (continued). 


(d) The mesh |P| of a C-partition P = {Aj,...,A,} is the largest of the 
diagonals dA;: 


|P| = max{dA, dAg, tee ,adA,}. 
Note 4. For any A € C, there is a sequence of C-partitions P, such that 


(i) each Py41 refines P;,, and 
(ii) Ting 325 | P| = 0. 


3 This also shows that an R-integral, when one exists, is always finite. 
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To construct such a sequence, bisect the edges of A so as to obtain 2” subinter- 
vals of diagonal 3dA (Chapter 3, §7). Repeat this with each of the subintervals, 
and so on. Then 


dA 


Lemma 3. Let f: A — E! be bounded. Let {Px} satisfy (i) of Note 4. If 
Pee TAY co: ae put 


qk 
on = D> Cae inf f[A¥] 


i=1 


and 
qk 


hy = D2 Cae sup f(A. 


i=1 
Then the functions 
g =supg, andh= inf hy 
k 


are Lebesgue integrable on A,* and 


(6) [a= sm sir <r] perf f< im UP) = fh. 
YA 


Proof. As in Theorem 2, we obtain gz, < f < hy on A with 


i: gn = S(f, Pr) 
A 


and 
A 

Since Px41 refines Px, it also easily follows that 
(7) Ge S Sev Soup ge = G9 SI Sh=inkhy S hess She. 
(Verify!) 

Thus {g,}? and {h;}|, and so 

g =supg, = lim gz and h = inf hy = lim hg. 
k k—oo k k— oo 

Also, as f is bounded, 
JK EE) |fl<K on A. 


“——~ 


4 Integrability is with respect to the measure m mentioned above. 
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The definition of g; and hy, then implies 
(Vk) |gx| SK and |hy| < K (why?), 
with 
[()=K-mA <0, 


The g, and hy are measurable (even simple) on A, with g, — g and hy — h. 
Thus by Theorem 5 and Note 1, both from 86, g and h are Lebesgue inte- 


grable,° with 
[ g= ep gp and i‘ L= ee hg. 
[uw=sarosrl f 
A JA 
[m=-Burmeef 
A A 


passage to the limit in equalities yields (6). Thus the lemma is proved. 


and 


Lemma 4. With all as in Lemma 3, let B be the union of the boundaries of 
all intervals from all P;,,. Let |P,| > 0. Then we have the following. 


(i) If f is continuous at p € A, then h(p) = g(p). 
(ii) The converse holds ifp € A—B. 
Proof. For each k, p is in one of the intervals in Px; call it Agp. 
If p € A— B, pis an interior point of Aj»; so there is a globe 
Galon) © Aggy: 
Also, by the definition of g, and hx, 
9k(p) = inf f[Axp] and hy = sup f[Axp]. 
(Why?) 
Now fix e > 0. If g(p) = h(p), then 
0 = h(p) — g(p) = lim [he (P) — ge (o)]; 


SO 


(Sk) |he(p) — ge(p)| = sup f[Axp] — inf f[Anp] < € 
As Gy(dxn) C Ap, we get 
(Vx Ee Gp(dx)) | f() — f(p)| < sup f[Axp] — inf f[Anp] <, 


5 Integrability is with respect to the measure m mentioned above. 
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proving continuity (clause (ii)). 
For (i), given ¢ > 0, choose 6 > 0 so that 


(Va,yEANGp(d)) lf) — fy) <e. 


Because 


(Vd > 0) (Sko) Vk > ko) |Prl <6 
for k > ko, Arp C Gp(d). Deduce that 
(Vk > ko) |ha(p) — ge(p)| <e. 


=~ 


Note 5. The Lebesgue measure of B in Lemma 4 is zero; for B consists of 
countably many “faces” (degenerate intervals), each of measure zero. 


Theorem 3. A map f: A — E' is R-integrable on A (with m = Lebesgue 
measure) iff f is bounded on A and continuous on A —Q for some Q with 
mQ = 0. 


Note that relative continuity on A — Q is not enough—take f = Cr of 
Note 2. 


Proof. If these conditions hold, choose {P;,} as in Lemma 4. 
Then by the assumed continuity, g = h on A— Q, mQ = 0. 


Thus 
fe- J" 
A A 
(Corollary 2 in §5). 


Hence by formula (6), f is R-integrable on A. 


Conversely, if so, use Lemma 1 with 
1 
ool eae 
2 


to get for each k some Py, such that 


1 
po 


S(f, Px) — S(f, Pr) < - — 0. 


By Corollary 1, this will still hold if we refine each P;,, step by step, so as to 
achieve properties (i) and (ii) of Note 4 as well. Then Lemmas 3 and 4 apply. 


As 


formula (6) shows that 


[s= lim S(f,P,) = lim BP) = f h. 
A k— oo k—0o A 
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As h and g are integrable on A, 


[o-a= [a- f amo. 


Also h — g > 0; so by Theorem 1(h) in §5, h = g on A— Q’, mQ = 0 (under 
Lebesgue measure). Hence by Lemma 4, f is continuous on 


AsO 8. 


with mB = 0 (Note 5). 
Let Q = Q’ UB. Then mQ = 0 and 


A-Q=A-Q'-B; 


so f is continuous on A — Q. This completes the proof. 


Note 6. The first part of the proof does not involve B and thus works even 
if m is not the Lebesgue measure. The second part requires that mB = 0. 

Theorem 3 shows that R-integrals are limited to a.e. continuous functions 
and hence are less flexible than L-integrals: Fewer functions are R-integrable, 
and convergence theorems (§6, Theorems 4 and 5) fail unless Rf, f exists. 


III. Functions f: E” — E* (C*). For such functions, R-integrals are defined 
componentwise (see §7). Thus f = (fi,...,f;) is R-integrable on A iff all fx 


(k < s) are, and then 
rf = aR ff 
; f 2 BR Y fe 


A complex function f is R-integrable iff f,. and fim are, and then 


Rf f=Rf forik | fw 


Via components, Theorems 1 to 3, Corollaries 3 and 4, additivity, linearity, 
etc., apply. 


IV. Stieltjes Integrals. Riemann used Lebesgue premeasure v only. But as we 
saw, his method admits other premeasures, too. 


Thus in E!, we may let m be the LS premeasure sq or the LS measure ma, 
where at (Chapter 7, §5, Example (b), and Chapter 7, §9). 


Then 
R i fdm 
A 


is called the Riemann-—Stieltjes (RS) integral of f with respect to a, also written 


Rf faa or n fs) date) 
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(the latter if A = [a,b]); f and a are called the integrand and integrator, 
respectively. 
If a(x) = %, M_ becomes the Lebesgue measure, and 


R | f(2)da(c) 
turns into 


Rf f2) dz. 


Our theory still remains valid; only Theorem 3 now reads as follows. 


Corollary 4. If f is bounded and a.e. continuous on A = |a,b] (under an 


LS measure mM.) then 
b 
R 7 fda 


exists. The converse holds if a is continuous on A. 


For by Notes 5 and 6, the “only if” in Theorem 3 holds if m,B = 0. Here 
B consists of countably many endpoints of partition subintervals. But (see 
Chapter 7, 89) ma{p} = 0 if @ is continuous at p. Thus the later implies 
MaB = 0. 

RS-integration has been used in many fields (e.g., probability theory, physics, 
etc.), but it is superseded by LS-integration, i.e., Lebesgue integration with 
respect to m,, which is fully covered by the general theory of 881-8. 

Actually, Stieltjes himself used somewhat different definitions (see Prob- 
lems 10-13), which amount to applying the set function og of Problem 9 in 
Chapter 7, 84, instead of sq or mq. We reserve the name “Stieltjes integrals,” 


denoted ‘ 
S i: f da, 


for such integrals, and “RS-integrals” for those based on mq or Sq (this termi- 
nology is not standard). 

Observe that oq, need not be > 0. Thus for the first time, we encounter 
integration with respect to sign-changing set functions. A much more general 
theory is presented in §10 (see Problem 10 there). 


Problems on Riemann and Stieltjes Integrals 


1. Replacing “M” by “C,” and “elementary and integrable” or “elemen- 
tary and nonnegative” by “C-simple,” prove Corollary 1(ii)(iv)(vii) and 
Theorems 1(i) and 2(ii), all in §4, and do Problem 5-7 in §4, for R- 
integrals. 


2. Verify Note 1. 
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. Do Problems 5-7 in 85 for R-integrals. 
. Do the following for R-integrals. 


(i) Prove Theorems 1(a)—(g) and 2, both in §5 (C-partitions only). 
(ii) Prove Theorem 1 and Corollaries 1 and 2, all in 86. 


(iii) Show that definition (b) can be replaced by formulas analogous to 
formulas (1’), (1”), and (1) of Definition 1 in §5. 


[Hint: Use Problems 1 and 2’.] 


. Fill in all details in the proof of Theorem 1, Lemmas 3 and 4, and 


Corollary 4. 


. For f,g: E” — E®* (C*), via components, prove the following. 


(i) Theorems 1-3 and 
(ii) additivity and linearity of R-integrals. 
Do also Problem 13 in §7 for R-integrals. 


. Prove that if f: A — E* (C*) is bounded and a.e. continuous on A, then 


ef ii|rf sl 


For m = Lebesgue measure, do it assuming R-integrability only. 


. Prove that if f,g: A - E! are R-integrable, then 


(i) so is f?, and 
(ii) so is fg. 
[Hints: (i) Use Lemma 1. Let h = |f| < K < co on A. Verify that 
(inf A[A;])? = inf f?[A;] and (sup h[Aj])? = sup f? [Ai]; 


© sup f2[Ai] — inf f2[As] = (sup A[Ai] + inf h[A¢]) (sup A[As] — inf A[Ai)) 
< (sup h[A;] — inf h[A;]) 2K. 


(ii) Use 


fg = IU +9)? -(f- 971 


(iii) For m = Lebesgue measure, do it using Theorem 3.] 


. Prove that ifm = the volume function v (or LS function sq for a contin- 


uous a), then in formulas (1) and (2), one may replace A; by A; (closure 
[Hint: Show that here mA = mA, 


rf p=r[es. 


and additivity works even if the A; have some common “faces” (only their interiors 
being disjoint).] 
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9. 


10. 


11. 


(Riemann sums.) Instead of S and S, Riemann used sums 


SEP i= >» f (xi) dmAj, 


where m = v (see Problem 8) and 2; is arbitrarily chosen from Aj. 
For a bounded f, prove that 


r=R | f dm 
A 
exists on A = [a,b] iff for every e > 0, there is P- such that 
fesGgeas) | <eé 
for every refinement 
P= {Ai} 


of P- and any choice of x; € Aj. 
[Hint: Show that by Problem 8, this is equivalent to formula (3).] 


Replacing m by the oq of Problem 9 of Chapter 7, §4, write S(f,P, a) 
for S(f,P) in Problem 9, treating Problem 9 as a definition of the 


Stieltjes integral, 
b b 
s| f da (ors [ f dow). 


Here f,a: E! — E' (monotone or not; even f,a: E! > C will do). 
Prove that if a: E! — E! is continuous and af, then 


s[ sio=R f feo, 


(Integration by parts.) Continuing Problem 10, prove that 


the RS-integral. 


exists iff 


does, and then 
b b 
s| fda+s f ad =k, 


where 


K = f(b) a(b) — f(a) a(a). 
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[Hints: Take any C-partition P = {A;} of [a, bj, with 
A; = [vi—1, vil, 


say. For any 2; € Aj, verify that 


S(f,P,a) = S~ f (wi) [a(ys) — a(yi—1)] = D> f (wi) ays) — D> f (vs) a(ys—-1) 


K => f(a) a(ys) — >> f(wi-1) a(yi-1)- 


and 


Deduce that 
K-S(f,P,a) = S(a,P’, f) = > aa) [F(as)—F(w)I— > oe(we—1) [Ff (vs) — fF (ia); 


here P’ results by combining the partition points 2; and y;, so it refines P. 
Now, if oi adf exists, fix P- as in Problem 9 and show that 


b 
k-su,P,0)-5 f ody] <eé 


whenever P refines P-.| 


If a: E1 = E’ is of class CD! on [a,b] and if 


8 [fae 


exists (see Problem 10), it equals 


b 
rf fen Oey ae 


(Hints: Set @ = fa’, P = {Ai}, Aj = [aj_1, ai]. Then 
P) = >° Fei) a! (as) (as — as-1), te € Ai, 
and (Corollary 3 in Chapter 5, §2) 
S(f,P,a) = D0 f(#i) [a(ai) — a(ai-1)] = D5 f(wi)a"(ai), € Ase 


As f is bounded and a’ is uniformly continuous on [a,b] (why?), deduce that 


(Ve > 0) (AP-) (VP refining P-) 


b 
|S(¢,P) ~ S(f,P,a)| < 5¢ and IsuP.a)—s f fda < 


1 
=€. 
2 
Proceed. Use Problem 9.] 


(Laws of the mean.) Let f,g,a: E' — E'; p< f < qon A = [a,)j; 
p,q € E'. Prove the following. 


(i) If af and if 
b 
S / f da 
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exists, then (4c € [p,q]) such that 


b 
sf f da = c[a(b) — a(a)]. 


rf faa 


exists, then (4c € [p,q]) such that 


b 
rf f da = c|a(b+) — a(a—)]. 


Similarly, if 


(i) If f also has the Darboux property on A, then c = f(xo) for some 
ro € A. 


(ii) If @ is continuous, and ff on A, then 


b b 
s i f da = [f() a(b) - f(a) a(a)] — / odf 


exists, and (4 z € A) such that 


8 [ raa= se) wie da + f(b) sf da 


= f(a) [a(z) — a(a)] + FO) [a() — a(z)]. 
(ii’) If g is continuous and ff on A, then (dz € A) such that 


nf sa) 94 ojde=p Rf of x)dxz+q- nf go 


If f|, replace f by —f. (See also Corollary 5 in Chapter 9, §1.) 


[Hints: (i) As af, we get 
b 
pla(s) —aa)) <5 f° fda <qla(b) ~ a(a)} 


(Why?) Now argue as in §6, Theorem 3 and Problem 2. 


(ii) Use Problem 11, and apply (i) to f adf. 
(ii’) By Theorem 2 of Chapter 5, §10, g has a primitive 8 € CD!. Apply Prob- 


lem 12 to Sf? f d@.] 
§10. Integration in Generalized Measure Spaces 


Let (S,M,s) be a generalized measure space. By Note 1 in §3, a map f is 
s-measurable iff it is v,-measurable. This naturally leads us to the following 
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definition. 

Definition 1. 
A map f: S — E is s-integrable on a set A iff it is v,-integrable on A. 
(Recall that v;, the total variation of s, is a measure.) 


Note 1. Here the range spaces of f and s are assumed complete and such 
that f(x) sA is defined for x € S and A € M. Thus if s is vector valued, f 
must be scalar valued, and vice versa. Later, if a factor p occurs, it must be 
such that p f(x) sA is defined, i.e., at least two of p, f(x), and sA are scalars. 


Note 2. Ifs isa measure (> 0), then vs = st = s (Corollary 3 in Chapter 7, 
811); so our present definition agrees with the previous ones (as in Theorem 1 
of §7). 


Lemma 1. If im! and m” are measures, with m’ >m" on M, then 


[i isiam' > fi pjame 


for all AE M and any f: S— E. 
Proof. First, take any elementary and nonnegative map g > |f\, 


g= S > Ca,4i on A. 


7 


Then (84) 


IV 


dm! = im’ A; 
[gam So aim 


Hence by Definition 1 in §5, 


/ f|dm' = inf | gam’ = inf [gam =f \sham', 
A g2\f\JA 92 \f| JA A 


as claimed. 


Samay = f gdm 
A 


V 


Lemma 2. 
(i) If s: M > E”(C”) with s = (s1,...,5n), and if f is s-integrable on 
AEM, then f is s,-integrable on A fork =1,2,...,n. 
(ii) If s is a signed measure and f is s-integrable on A, then f is integrable 
on A with respect to both st and s~ (with st and s~ as in formula (3) 
in Chapter 7, §11). 
Note 3. The converse statements hold if f is M-measurable on A. 
Proof. 
(i) If s = (s1,..., Sn), then (Problem 4 of Chapter 7, §11) 


te Vey a doce ts 
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Hence by Definition 1 and Lemma 1, the s-integrability of f implies 


co> f flav, > [ ee 
A A 


Also, f is vs-measurable, i.e., M-measurable on A — Q, with 
0=v.Q > Vs,Q = 0. 
Thus f is sz,-integrable on A, k = 1,... ,n, as claimed. 


(ii) If s = st — s~, then by Theorem 4 in Chapter 7, §11, and Corollary 3 
there, st and s~ are measures (> 0) and vs = st + s—, so that both 


Us > St =v,4+ andu, >s =0,-. 


Thus the desired result follows exactly as in part (i) of the proof. 


We leave Note 3 as an exercise. 
Definition 2. 
If f is s-integrable on A € M, we set 
(i) in the case s: M > E*, 


[ tas= [ fast f fas, 


with s+ and s~ as in formula (3) of Chapter 7, §11;1 
(ii) in the case s: M > E”(C”), 


[tes= dee | 


with e; as in Theorem 2 of Chapter 3, §$1-3; 
(iii) ifs: MC, 


[ tas= f fase+i- fi fasin 


(See also Problems 2 and 3.) 


Note 4. If s is a measure, then 


and 


1 By choosing s+ and s~ as in formula (3) of Chapter 7, §11, we avoid ambiguity. 
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so Definition 2 agrees with our previous definitions. Similarly for s: M — 
E"(c™). 

Below, s, t, and u are generalized measures on M as in Definition 2, while 
f,g: S — E are functions, with FE’ a complete normed space, as in Note 1. 
Theorem 1. The linearity, additivity, and o-additivity properties (as in §7, 
Theorems 2 and 3) also apply to integrals 


| fe 

A 

with s as in Definition 2. 

Proof. (i) Linearity: Let f,g: S — E be s-integrable on A € M. Let p,q be 
suitable constants (see Note 1). 

If s is a signed measure, then by Lemma 2(ii) and Definitions 1 and 2, f is 
integrable with respect to vs, st, and s~. As these are measures, Theorem 2 
in §7 shows that pf + qg is integrable with respect to v,, st, and s~, and by 
Definition 2, 


sS= gt — Ss 
[wr+ane [or+ane [or+ane 


=r | fast +a gast—p [ fas —a | gas 
A A A A 
=» | fas+af gas, 

A A 


Thus linearity holds for signed measures. Via components, it now follows 
for s: M — E” (C”) as well. Verify! 
(ii) Additivity and o-additivity follow in a similar manner. 


Corollary 1. Assume f is s-integrable on A, with s as in Definition 2. 
(i) If f is constant (f =c) on A, we have 


| fasse-sa 
A 


7 = SS Ay Ca; 
for an M-partition {A;} of A, then 


fds = S/ a; 8A; and | |f|ds = S © |ai| 8A; 
po aes ie) 


(both series absolutely convergent). 


(ii) If 
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(iii) |f| <00 ae. on A? 

(iv) [, |fldus =0 iff f =0 ae. on A. 

(v) The set A(f #0) is (us) o-finite (Definition 4 in Chapter 7, §5). 
(vi) [, fds= fy. od ds ifusQ =0 or f=0 onQ (QE M). 
(vii) f is s-integrable on any M-set BC A. 


Proof. 


(i) If s = st —s~ is a signed measure, we have by Definition 2 that 


[ tas= f past — f fas =c(stA—s A) =c:sA, 


as required. 
For s: M — E” (C”), the result now follows via components. (Verify!) 


(ii) As f =a; on Aj, clause (i) yields 


i fds=a;sA;, it=1,2,.... 
Aj 


Hence by o-additivity, 


[i= fe sas=Dawsds 


as claimed. 


Clauses (iii), (iv), and (v) follow by Corollary 1 in 85 and Theorem 1(b)(h) 
there, as v, is a measure; (vi) is proved as §5, Corollary 2. We leave (vii) as an 
exercise. 


Theorem 2 (dominated convergence). If 
f = lim f; (pointwise) 
on A—Q (vsQ = 0) and if each f; is s-integrable on A, so is f, and 


[ fds= lim ie 


all provided that 
(Vi) |fil <9 
for some map g with [, gdvs < oo. 
Proof. If s is a measure, this follows by Theorem 5 in 86. Thus as v, is a 


measure, f is v,-integrable (hence s-integrable) on A, as asserted. 


? That is, on A— Q, vsQ = 0. 
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Next, if s = st —s7~ is a signed measure, Lemma 2 shows that f and the f; 
are st and s~-integrable as well, with 


lds <= f |fldte< dvs < 00; 
fil g 
A A A 


[ \tlas-. 


As st and s~ are measures, Theorem 5 of §6 yields 


[sess [ tast— [pas =tim( [feast — f feas-) tim f foas 


Thus all is proved for signed measures. 
In the case s: M — E”(C™”), the result now easily follows by Defini- 
tion 2(ii)(iii) via components. 


similarly for 


Theorem 3 (uniform convergence). Jf fj — f (uniformly) on A—Q (vsA < 
00, UsQ = 0), and if each f; is s-integrable on A, so is f, and 


/ fds= lm | jf,ds. 
A A 


i—00 


Proof. Argue as in Theorem 2, replacing §6, Theorem 5, by 87, Lemma 1. 


Our next theorem shows that integrals behave linearly with respect to mea- 
sures. 


Theorem 4. Let t,u: M — E* (E”, C”), with 4, < co on M,? and let 
s=pt+qu 
for finite constants p and q. Then the following statements are true. 
(a) Ift and u are generalized measures, so is s. 


(b) If, further, f is M-measurable on a set A and is both t- and u-integrable 
on A, it is also s-integrable on A, and 


[tas=vf tara tau 


Proof. We consider only assertion (b) for s = t+ u; the rest is easy. 
First, let f be M-elementary on A. By Corollary 1(ii), we set 


[faa Data and | fdu= Saud, 
A : A ; 


3 Or |t| < 00; see Theorem 6 in Chapter 7, §11. The restriction is redundant if t: M — 
BM G?), 
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Also, by integrability, 


oO > } flay = > |a;|v,A; and co > | |f|dvy = > |a;| Vn Ai- 
A A i 
Now, by Problem 4 in Chapter 7, §11, 


Us = Uitu S Ut + Vu} 


SO 


I Hfldvs = Jail vss 
< Dla Art+ wd) =f Ifldoet f fides < 00. 


As f is also M-measurable (even elementary), it is s-integrable on A (by Def- 
inition 1), and 


[f= Davsdi= Datta tuay= f pars f sau 


as claimed. 
Next, suppose f is M-measurable on A and v,A < co. By assumption, 
uzA < 00, too; so 
vA <UMAt+vU,A < oO. 


Now, by Theorem 3 in §1, 
f = lim f; (uniformly) 


for some M-elementary maps f; on A. By Lemma 2 in 87, for large i, the f; 
are integrable with respect to both 1 and v, on A. By what was shown above, 
they are also s-integrable, with 


I fids = I fidt + I eau 


With 7 — oo, Theorem 3 yields the result. 

Finally, let v,A = oo. By Corollary 1(v), we may assume (as in Lemma 3 
of §7) that A; 7 A, with v,A; < co, and vu,A; < oo (since y% < oo, by 
assumption). Set 

fi =f Ca, — f (pointwise) 
on A, with |f;| < |f|. (Why?) 


As f; = f on A; and f; = 0 on A— Aj, all f; are both t- and u-integrable on 
A (for f is). Since v,A; < oo and v,A; < oo, the f; are also s-integrable (as 
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shown above), with 


[na= fe fds =f feats [ fidu= [fats [fide 


With 71 — oo, Theorem 2 now yields the result. 

To complete the proof of (b), it suffices to consider, along similar lines, the 
case s = pt (or s = qu). We leave this to the reader. 

For (a), see Chapter 7, §11. 


Theorem 5. [f f is s-integrable on A, so is |f|, and 


[fe < f \ldv. 


Proof. By Definition 1, and Theorem 1 of §1, f and |f| are M-measurable on 
A—Q, v,Q = 0, and 


J lflavs < 003 


so |f| is s-integrable on A. 
The desired inequality is immediate by Corollary L(ii) if f is elementary. 
Next, exactly as in Theorem 4, one obtains it for the case v,A < oo, and 

then for v,A = o. We omit the details. 


Definition 3. 


We write 
“ds = gdt in A” 


= / gdt in A” 
iff g is t-integrable on A, and 


x= gat 
x 
for AD X, X EM. 


We then call s the indefinite integral of g in A. (fy gat may be 
interpreted as in Problems 2-4 below.) 


or 


Lemma 3. If AG M and 
ds = gdt in A, 


then 
dus = |g| du; in A. 
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Proof. By assumption, g and |g| are v;-integrable on X, and 


x= gat 
54 


for AD X, X € M. We must show that 


wx =f \g| du; 
x 
for such X. 


This is easy if g = c (constant) on X. For by definition, 
UsX = sup )> |sX;|, 
PG 
over all M-partitions P = {X;} of X. As 
sX;= if gdt=c-txX;, 
Xi 


we have 
v,X = sup c| |tX;| = |e] sup tX;| = |cl up-X; 


sO 


wX= f |g| duz. 
x 


Thus all is proved for constant gq. 
Hence by o-additivity, the lemma holds for M-elementary maps g. (Why?) 
In the general case, g is t-integrable on X, hence M-measurable and finite 
on X —Q, v,Q = 0. By Corollary 1 (iii), we may assume g finite and measurable 
on X; so 
gS im, gx (uniformly) 


on X for some M-elementary maps gz, all integrable on X, with respect to 1% 


(and t). 
Ss. = | dt 


Let 
in X. By what we just proved for elementary and integrable maps, 


1X =f lop avin. “Ue = Ay 2ecuces 
x 


Now, if u4.X < oo, Theorem 3 yields 


i |g| du, = lim | \gx| du; = lim vs, X = v,X 
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(see Problem 6). Thus all is proved if v,X < oo. 
If, however, v,X = oo, argue as in Theorem 4 (the last step), using the left 
continuity of v, and of 
[ iolave 


Theorem 6 (change of measure). If f is s-integrable on AE M, with 


Verify! 


ds = gdt in A, 


then (subject to Note 1) fg is t-integrable on A and 


[ tes= [toate 


(Note the formal substitution of “gdt” for “ds.” ) 


Proof. The proof is easy if f is constant or elementary on A (use Corol- 
lary 1(ii)). We leave this case to the reader, and next we assume g is bounded 
and 14.A < oo. 

By s-integrability, f is M-measurable and finite on A — Q, with 


0=1.9= | \g| duz 
Q 


by Lemma 3. Hence 0 = g = fg on Q — Z, v,.Z =0. Therefore, 


[ toate=o= f fas 


for v,Q = 0. Thus we may neglect @ and assume that f is finite and M- 
measurable on A. 
As ds = gdt, Definition 3 and Lemma 3 yield 


vUsA -/ \g| duz < co. 
A 
Also (Theorem 3 in Chapter 8, 81), 
f= jim fe (uniformly) 


for elementary maps f;, all v,-integrable on A (Lemma 2 in §7). As g is 
bounded, we get on A 


fg= jim fxg (uniformly). 
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Moreover, as the theorem holds for elementary and integrable maps, fxg is 
t-integrable on A, and 


| teas f nogat k=1,2,.... 
A A 


Since v,A < oo and vu:A < co, Theorem 3 shows that fg is t-integrable on 


A, and 
| fas= lim [fas - tim | figat =f foc. 


Thus all is proved if 4A < oo and g is bounded on A. 

In the general case, we again drop a null set to make f and g finite and 
M-measurable on A. By Corollary 1(v), we may again assume A; “7 A, with 
uzA; < oo (Vi). 

Now fori =1,2,... set 

fg on Aillgl <i), 
: 0 elsewhere. 
Then each g; is bounded, 
gi — g (pointwise), 
and 
l9i| < Igl 
on A. We also set f; = f Ca,; so f; — f (pointwise) and |f;| < |f| on A. Then 


[aaa feds = f igid= [tesa 


(Why?) Since | figi| < |fg| and fig: — fg, the result follows by Theorem 2. 


Problems on Generalized Integration 


Recall that in this section EF’ is assumed to be a complete normed space. 


1. Fill in the missing details in the proofs of this section. Prove Note 3. 


2. Treat Corollary 1(ii) as a definition of 


[0 


for s:M — E and elementary and integrable f, even if E 4 E” (C”). 
Hence deduce Corollary 1(i)(vi) for this more general case. 


3. Using Lemma 2 in 87, with m = v,, s: M — E, construct 


[te 
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as in Definition 2 of §7 for the case v,A # co. Show that this agrees 
with Problem 2 if f is elementary and integrable. Then prove linearity 
for functions with v,-finite support as in 87. 


. Define 


[tes (s: M— E) 


also for v,A = o. 
[Hint: Set m = vs in Lemma 3 of §7.] 


. Prove Theorems 1 to 3 for the general case, s: M — E (see Problem 4). 


[Hint: Argue as in §7.] 


. From Problems 2-4, deduce Definition 2 as a theorem in the case E = 


E"(C), 


. Let s,5,: M > E (k =1,2,...) be any set functions. Let A € M and 


Ma ={X EM|xX C A}. 
Prove that if 
(VX € Maz) jim Spx = 8X, 
then 


lim v,,A = v,A, 
k—-00 


provided lim v,, exists. 
k—oo 


[Hint: Using Problem 2 in Chapter 7, §11, fix a finite disjoint sequence {X;} C M4. 


Then 
X;| = li X;| = li X;| <li s, A. 
ee ee 
Infer that 
vsA < lim vs, A. 
k—-00 
Also, 
(Ve > 0) (Ako) (Vk > ko) S- |s~Xi| < S- |sX;| te <vusAte. 

Proceed.| 


. Let (X,M,m) and (Y,N,n) be two generalized measure spaces (X € 


M, Y €N) such that mn is defined (Note 1). Set 
C={AxB|AEM, BEN, vumA< ow, nB < co} 


and s(A x B) =mA-nB for Ax BEC. 
Define a Fubini map as in §8, Part IV, dropping, however, [ eeued OP 
from Fubini property (c) temporarily. 
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10. 


Then prove Theorem 1 in §8, including formula (1), for Fubini maps 
so modified. 


[Hint: For o-additivity, use our present Theorem 2 twice. Omit P*.] 


. Continuing Problem 7, let P be the o-ring generated by C in X x Y. 


Prove that (VD € P) Cp is a Fubini map (as modified). 


[Outline: Proceed as in Lemma 5 of 88. For step (ii), use Theorem 2 in 810 twice.] 


. Further continuing Problems 7 and 8, define 


(VDEP) pD= | [ Cydnam. 
xJy 


Show that p is a generalized measure, with p = s on C, and that 
(VDEP) pD= Cp dp, 
XxKY 


with the following convention: If X x Y ¢ P, we set 


[fire [1 


whenever H € P, f is p-integrable on H, and f = 0 on —H. 
Verify that this is unambiguous, i.e., 


ee 


so defined is independent of the choice of H. 


Finally, let p be the completion of p (Chapter 7, §6, Problem 15); let 
P* be its domain. 
Develop the rest of Fubini theory “imitating” Problem 12 in §8. 


Signed Lebesgue—Stieltjes (LS) measures in E are defined as shown in 
Chapter 7, §11, Part V. Using the notation of that section, prove the 
following: 


(i) Given a Borel-Stieltjes measure o* in an interval J C E? (or an 
LS measure sg = o*, in J), there are two monotone functions gf 
and ht (a = g —h) such that 


M,=— 8, and my, = 6, , 
both satisfying formula (3) of Chapter 7, §11, inside J. 
(ii) If f is s,-integrable on A C J, then 


[ fasa= f fam fi pam, 


for any gt} and h} (finite) such that a = g—h. 
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[Hints: (i) Define st and sq by formula (3) of Chapter 7, §11. Then arguing as in 
Theorem 2 in Chapter 7, 89, find gf and hf with mg = sq and mp, = 8a. 
(ii) First let A = (a,b] C J, then A € B. Proceed.] 


*$11. The Radon—Nikodym Theorem. Lebesgue Decomposition 


I. As you know, the indefinite integral 


[tam 


is a generalized measure. We now seek conditions under which a given gener- 
alized measure jz can be represented as 


p= [ tam 


for some f (to be found). We start with two lemmas. 


Lemma 1. Let m,u: M — [0,00) be finite measures in S. Suppose S € M, 
pS > 0 (t.e., 2 #0) and p is m-continuous (Chapter 7, §11). 
Then there is 6 > 0 and a set PE M such that mP > 0 and 


(VXEM) pX>6-m(XNP). 


Proof. As m < oo and uS > 0, there is 6 > 0 such that 


pS —d-mS > 0. 
Fix such a 6 and define a signed measure (Lemma 2 of Chapter 7, §11) 
® = p — dm, 
so that 
1) (VY EM) SY =yY —5-myY; 
hence 


OS = pS —d-mS > 0. 
By Theorem 3 in Chapter 7, §11 (Hahn decomposition), there is a ®-positive 
set P € M with a ®-negative complement —P=S—PeEWM. 
Clearly, mP > 0; for if mP = 0, the m-continuity of 4 would imply wP = 0, 
hence 


®P=uP—d-mP=0, 
contrary to PP > OS > 0. 


*§11. The Radon—Nikodym Theorem. Lebesgue Decomposition 337 


Also, PD Y and Y € M implies ®Y > 0; so by (1), 
O0< pY —6-mY. 
Taking Y = X MP, we get 
dsm ANP) <p XP) < Bx, 


as required. 


Lemma 2. With m, yu, and S as in Lemma 1, let H be the set of all maps 
g: S— E*, M-measurable and nonnegative on S, such that 


| gdm < px 
xX 


for every set X from M. 
Then there is f © H with 


dm = dm. 
[tam mas [gdm 


Proof. H is not empty; e.g., g =0 is in H. We now show that 
(2) (VghEH) gVh=max(g,h) € H. 


Indeed, g V h is > 0 and M-measurable on S, as g and h are. 
Now, given X € M, let Y = X(g >h) and Z = X(g <h). Dropping “dm” 
for brevity, we have 


[ovm=fovm+ fovm= for frsuytuz=nx, 


proving (2). 
Let 


k= sup f gdme E. 
gEH JS 


Proceeding as in Problem 13 of Chapter 7, 86, and using (2), one easily finds 
a sequence {gn}}, gn € H, such that 


lim Og, dm = ks 
S 


n—- Co 


(Verify!) Set 
= lim gn. 


n—-oo 


(It exists since {g,,}1.) By Theorem 4 in §6, 


k= lim [w= P 
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Also, f is M-measurable and > 0 on S, as all gy are; and if X € M, then 


(vn) | aye 
xX 


hence 
x 


n—-Co 


[t=r=sw fo 


= max < o < oo. 
fis max | a <1 
This completes the proof. 


Thus f € H and 


Le., 


Note 1. As w < co and f > 0, Corollary 1 in §5 shows that f can be made 
finite on all of S. Also, f is m-integrable on S. 


Theorem 1 (Radon—-Nikodym). If (S,M,m) is a o-finite measure space, if 
SEM, and if 
pp: M — E” (C”) 


is a generalized m-continuous measure, then 


| i] fdm on M 
for at least one map 
f:S— E"(c"), 
M-measurable on S. 
Moreover, if h is another such map, then mS(f #h) =0 


The last part of Theorem 1 means that f is “essentially unique.” We call f 
the Radon—Nikodym (RN) derivative of 4, with respect to m. 


Proof. Via components (Theorem 5 in Chapter 7, §11), all reduces to the case 
pi M— E',” 

Then Theorem 4 (Jordan decomposition) in Chapter 7, §11, yields 
tan =i, 

where p* and yp are finite measures (> 0), both m-continuous (Corollary 3 


from Chapter 7, §11). Therefore, all reduces to the case 0 < pp < ov. 
Suppose first that m, too, is finite. Then if = 0, just take f = 0. 
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If, however, uS > 0, take f € H asin Lemma 2 and Note 1; f is nonnegative, 
bounded, and M-measurable on S, 


[fsuxco, 


and 


fdm=k=sup f gam. 
Ss Ss 


gEH 


We claim that f is the required map. 


Indeed, let 
v= | fam: 


so vy is a finite m-continuous measure (> 0) on M. (Why?) We must show 
that v = 0. 


Seeking a contradiction, suppose vS > 0. Then by Lemma 1, there are 
PeéeM and 6>0 such that mP > 0 and 


(VXEM) vX >5-m(XNP). 


Now let 
g=f+5-Cp; 


so g is M-measurable and > 0. Also, 
(VX € M) fo=fseef Cr= f f+5-m(XnP) 
x x x x 
< f feuxnP) 
x 


< f prox =ux 
x 


by our choice of 6 and v. Thus g € H. On the other hand, 


S S S 


k = sup | g. 
geHJS 
This proves that | f = ju, indeed. 
Now suppose there is another map h € H with 


p= [ham= f fam 400% 


contrary to 
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sO 


[(f- mam =o. 
(Why?) Let 
Y =S(f >h) and Z=S(f <h); 


so Y,Z € M (Theorem 3 of §2) and f —h is sign-constant on Y and Z. Also, 
by construction, 


[¢-mam=o= [ ¢- nam. 


Thus by Theorem 1(h) in §5, f—h = 0a.e. on Y, on Z, and hence on S = YUZ; 
that is, 
mS(f #h)=0. 


Thus all is proved for the case mS < oo. 
Next, let m be o-finite: 


S = [J Sk (disjoint) 
k=1 
for some sets S; € M with mS; < oo. 


By what was shown above, on each S; there is an M-measurable map f; > 0 
such that 


| fedm = pX 

x 

for all M-sets X C S;,. Fixing such an f;, for each k, define f: S > E' by 
fHie omSe,, FS 125s 


Then (Corollary 3 in §1) f is M-measurable and > 0 on S. 
Taking any X € M, set X, = XM S;. Then 


X = LJ Xx (disjoint) 
k=1 


and X; € M. Also, 
(Vk) | fam = fram= pXe. 
Xi Xz 
Thus by o-additivity (Theorem 2 in §5), 


| tan=> | fdm=S~ pX,=uX <c (1 is finite!). 
si k=1’ Xk k 


Thus f is as required, and its “uniqueness” follows as before. 
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Note 2. By Definition 3 in 810, we may write 
“di — ri dm” 


“| f dm = jh.” 


Note 3. Using Definition 2 in 810 and an easy “componentwise” proof, one 
shows that Theorem 1 holds also with m replaced by a generalized measure s. 
The formulas 


for 


w= | fdm and ms(f # h) =0 


then are replaced by 


w= [tas and a,9(f # h) = 0. 


II. Theorem 1 requires pz to be m-continuous (u << m). We want to generalize 
Theorem 1 so as to lift this restriction. First, we introduce a new concept. 


Definition. 
Given two set functions s,t: M — E (M C 2%), we say that s is t- 
singular (s L t) iff there is a set P € M such that v,P = 0 and 
(3) (VXEM|XC-P) sx =0. 
(We then briefly say “s resides in P.”) 
For generalized measures, this means that 
(VX EM) sX =s(XNP). 
Why? 
Corollary 1. If the generalized measures s,u: M — E are t-singular, so is 


ks for any scalar k (if s is scalar valued, k may be a vector). 
So also are stu, provided t is additive. 


(Exercise! See Problem 3 below.) 


Corollary 2. If a generalized measure s: M — E is t-continuous (s < t) and 
also t-singular (s 1 t), then s =0 on M. 


Proof. As s 1 t, formula (3) holds for some P € M, v;P = 0. Hence for all 
XeEM, 
s(X — P) =0 (for X - PC —P) 


and 
v1(XOP)=0 Gor XP CP), 
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As s < t, we also have s(X MP) = 0 by Definition 3(i) in Chapter 7, §11. Thus 
by additivity, 
sX =3s(XN P)+s(X — P) =0, 


as claimed. 


Theorem 2 (Lebesgue decomposition). Let s,t: M — E be generalized mea- 
sures. 

If vs is t-finite (Definition 3(iii) in Chapter 7, §11), there are generalized 
measures s',s!"": M — E such that 


s'<tands” Lt 
and 
s=s'4+s". 
Proof. Let vp be the restriction of v, to 
Mo ={X €M|uX = 0}. 


As vs is a measure (Theorem 1 of Chapter 7, §11), so is vp (for Mo is a o-ring; 
verify!). 
Thus by Problem 13 in Chapter 7, 86, we fix P € Mo, with 


UsP = uP = max{v,X | X € Mo}. 
As P € Mo, we have v;P = 0; hence 
[sP| <u.P < oo 

(for vu, is t-finite). 
Now define s’, s”, v’, and uv” by setting, for each X € M, 

s'X = 8(X — P); 

eX Sar 1P): 

vu X =v,(X — P); 

Ce ane Gara 
As s and v, are o-additive, so are s’, s”, vu’, and v”. (Verify!) Thus 
s',s": M — E are generalized measures, while v’ and v” are measures (> 0). 

We have 
(VX EM) sX=s(X —P)4+s5(XNP)=8'X4+58"X; 
Le., 
seas ts”. 


Similarly one obtains v, = v’ + uv”. 
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Also, by (5), since XN P=9, 
—-PD>X andXe€M=> s"X =0, 
while v;P = 0 (see above). Thus s” is t-singular, residing in P. 
To prove s’ < t, it suffices to show that uv’ < t (for by (4) and (6), v/X =0 
implies |s’X| = 0). 
Assume the opposite. Then 


(AY eM) vuY =0 


(ie., Ye Mo), but 
0<v'Y =0,(Y —P). 


So by additivity, 
us(Y UP) =v,P + 0,(Y — P) > v.P, 
with YUP € Mo, contrary to 
usP = max{vu,X | X € Mo}. 


This contradiction completes the proof. 


Note 4. The set function s” in Theorem 2 is bounded on M. Indeed, s” | t 
yields a set P € M such that 


(VXEM) s"(X—P)=0; 
and v;P = 0 implies v,P < oo. (Why?) Hence 
s"X =s"(XNP)4+s"(X —P)=s" (XNP). 
As s = s'+8", we have 
|s”| < |s| + |s’| < vs + 503 


so 
|s”X| = |s"(X NP)| < usP + vs/P. 

But v,P = 0 by t-continuity (Theorem 2 of Chapter 7, §11). Thus |s”| < 

vsP < oon M. 


Note 5. The Lebesgue decomposition s = s’ + s’” in Theorem 2 is unique. 
For if also 
u’<tandu” Lt 


and 
utu”=s=s'+s8", 


then with P as in Problem 3, (VX € M) 
(8) s(XNP)+s"(XNP) =u (XN P)+u" (XP) 
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and u.(X 9 P) =0. But 
SX) =V=a COP) 
by t-continuity; so (8) reduces to 
xn PyHu (Anh), 
or s”X =u" X (for s” and u” reside in P). Thus s” =u” on M. 
By Note 4, we may cancel s” and wu” in 
gi + 5! =u +u" 
to obtain s’ = wu’ also. 


Note 6. If E = E” (C”), the t-finiteness of v, in Theorem 2 is redundant, 
for vs is even bounded (Theorem 6 in Chapter 7, §11). 
We now obtain the desired generalization of Theorem 1. 


Corollary 3. If (S,M,m) is a o-finite measure space (S € M), then for any 
generalized measure 
pi M— E"(C"), 
there is a unique m-singular generalized measure 
s”: M > E” (C”) 
and a (“essentially” unique) map 
fia BC"); 


M-measurable and m-integrable on S, with 
p= if fdm+s". 


(Note 3 applies here.) 
Proof. By Theorem 2 and Note 5, 4 = s’ + 8” for some (unique) generalized 
measures s’,5”: M — E” (C™), with s’ < mand s” | m. 


Now use Theorem 1 to represent s’ as [{ f dm, with f as stated. This yields 
the result. 


Problems on Radon—Nikodym 
Derivatives and Lebesgue Decomposition 


1. Fill in all proof details in Lemma 2 and Theorem 1. 


2. Verify the statement following formula (3). Also prove the following: 
(i) If P€ M along with —P € M, then s | t implies t L s; 
(il) @Jb¢ i Gy J. 


*§11. The Radon—Nikodym Theorem. Lebesgue Decomposition 345 


3. Prove Corollary 1. 


[Hints: Here M is a o-ring. Suppose s and u reside in P’ and P”, respectively, and 
vzeP’ =0= uP”. Let P= P/UP” © M. Verify that veP = 0 (use Problem 8 in 
Chapter 7, §11). Then show that both s and u reside in P.] 


4. Show that if s: M — E* is a signed measure in S € M, then st 1 s~ 
and s~ 1 st. 


5. Fill in all details in the proof of Theorem 2. Also prove the following: 


(i) s’ and v, are absolutely t-continuous. 
[Hint: Use Theorem 2 in Chapter 7, §11.] 


(ii) Us = Ug + Ug, Use Lt. 
(iii) If s is a measure (> 0), so are s’ and 5”. 


6. Verify Note 3 for Theorem 1 and Corollary 3. State and prove both 
generalized propositions precisely. 


*§12. Integration and Differentiation 


I. We shall now link RN-derivatives (§11) to those of Chapter 7, §12. 
Below, we use the notation of Definition 3 in Chapter 7, §10 and Definition 1 
of Chapter 7, §12. (Review them!) In particular, 


m: M* — E* 


is Lebesgue measure in £” (presupposed in such terms as “a.e.,” etc.); s is an 
arbitrary set function. For convenience, we set 


s'(p) =0 


[ fam =o. 


unless defined otherwise; thus s’ and [, f exist always. 
We start with several lemmas that go back to Lebesgue. 


Lemma 1. With the notation of Definition 3 of Chapter 7, 810, the functions 
Ds, Ds, and s’ 


and 


are Lebesgue measurable on E” for any set function 
s:M’ > E* (M' DK). 


Proof. By definition, 
Ds(p) = inf h,(p), 
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where 
sl 
r Dn) = — T is 
h,(p) su = | es} 


and 
_ 1 
Kj={reK|per, ar< =}, r=1,2,.... 


As is easily seen (verify!), 

= sl 1 
1 EE” (hyp > a) = reK| <—,dI<-}, ec E*. 
(1 (he >a=Ufrek fax, ar< th, a 


The right-side union is Lebesgue measurable by Problem 2 in Chapter 7, 810. 
Thus by Theorem 1 of 82, the function h, is measurable on E” for r = 1,2,..., 
and so is 

Ds = inf hy 


by Lemma 1 of 82 and Definition 3 in Chapter 7, 810. Similarly for Ds. 
Hence by Corollary 1 in §2, the set 
A=B"(Ds— Ds) 


is measurable. As s’ = Ds on A, s’ is measurable on A and also on —A (by 
convention, s’ = 0 on —A), hence on all of E”. 


Lemma 2. With the same notation, let s: M' > E* (M' DK) be a regular 
measure in E”. Let AC M* and BE M' with AC B, anda€ E'. 
If 
Ds>a onA, 
then 
a-mA< sB. 


Proof. Fix « > 0. By regularity (Definition 4 in Chapter 7, §7), there is an 
open set G > B, with 
sB+e>sG. 


Now let 
Ke ={TeK|ICG, sI> (a—e)mi}. 


As Ds > a, the definition of Ds implies that K* is a Vitali covering of A. 
(Verify!) 
Thus Theorem 1 in Chapter 7, §10, yields a disjoint sequence {I} C K*, 


with 
m(A a Us) =i 
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and 


mA <m(A-|)ik) +m|JIe=0+mUJ ik = 5) mk. 
k 


OEE CGandsB+e>sG 
(by our choice of K* and G), we obtain 


sB+e>s|JIk= 5 sk > (a—e€) 5 ml > (a—€) mA. 
k k k 


Thus 
(a-—e)mA<sBrte. 


Making ¢ — 0, we obtain the result. 


Lemma 3. If 
t=stu, 
with s,t,u: M!’ — E* and M' DK, and if u is differentiable at a point p € E”, 
then 
Dt=Dstu' and Dt=Ds+w' at p. 


The proof, from definitions, is left to the reader (Chapter 7, §12, Problem 7). 
Lemma 4. Any m-continuous measure s: M* — E! is strongly regular. 


Proof. By Corollary 3 of Chapter 7, §11, v; = s < oo (s is finite!). Thus v, is 
certainly m-finite. 

Hence by Theorem 2 in Chapter 7, §11, s is absolutely m-continuous. So 
given € > 0, there is 6 > 0 such that 


(VX Ee M*|mxX <6) sX <e. 


Now, let A € M*. By the strong regularity of Lebesgue measure m (Chap- 
ter 7, §8, Theorem 3(b)), there is an open set G D A and a closed FC A such 
that 


m(A— F) <6 and m(G— A) <6. 
Thus by our choice of 0, 
s(A— F) <e and s(G— A) <e, 


as required. 
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Lemma 5. Let s,s, (k = 1,2,...) be finite m-continuous measures, with 
Sk 7 8 or S&& \ 8 on M*. 
If the sz are a.e. differentiable, then 


Da= Ds= lim 3}. ae. 
k— oo 


Proof. Let first s, 7 s. Set 
th =S— Sp. 


By Corollary 2 in Chapter 7, $11, all t, are m-continuous, hence strongly reg- 
ular (Lemma 4). Also, ty \, 0 (since s, 7 5). Hence 


tel > tpaad & U 
for each cube J; and the definition of Dt; implies that 
Dty > Dtp1 > Dty41 > 0. 


As {Dtx}1, jim Dty exists (pointwise). Now set 
—0o 


a . 
A, = E"( lim Di > -), PWD yc 
k— oo Tr. 


By Lemma 1 (and Lemma 1 in §2), A, € M*. Since 


Dt, > lim Dt; > — 


t1— CO TT 
on A,, Lemma 2 yields 
1 
= mA, < t, Ap. 
ip 
As tz \, 0, we have 
1 
—mA, < lim t,A, =0. 
r k—-o0o 


Thus 
mA, =U, PS 1, 2oxsas 


Also, as is easily seen, 
Yo P pekiien. =e «. aa 
Be Pat) (ee Dae) Ue 
and 


m v A, =0. 
r=l1 


Hence _ 
lim Dt, <0 a.e. 
k-00 
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As 
Dt; > Dt, > 0 

(see above), we get 

lim Dt, =0= lim Dt, ae. on E”. 

k—oo k—-00 
Now, as t, = s — sx and as the s, are differentiable, Lemma 3 yields 

Dt, = Ds — s;, and Dt, = Ds — sj, ae. 
Thus 
lim (Ds — s,) = 0 = lim(Ds — s;), 


Le., 
Ds= lim 5 =Ds ae. 
k—o0o 
This settles the case s;, 7 s. 


In the case s, \, s, one only has to set t, = s, — s and proceed as before. 
(Verify!) 


Lemma 6. Given A € M*, mA < ow, let 


s= [ Cadm 


on M*. Then s is a.e. differentiable, and 
s =Cy, a.e. on E”. 
(C4 = characteristic function of A.) 


Proof.' First, let A be open and let p € A. 

Then A contains some G5(5) and hence also all cubes I € K with dI < 6 
and pe I. 

Thus for such I € K, 


t= [ Cadm= f (1)dm = mi: 
I I 
Le., 
sl 
mil 
Hence by Definition 1 of Chapter 7, 812, 
s'(p) =1=Ca(p) 


1=C,a(p), Per: 


if p € A; ie., s’ =Cy on A. 


| Differentiability follows by Theorem 4 of Chapter 7, §12, but we obtain it anyway. 
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We claim that 
Ds=s'=0 ae. on—A. 


s= [Cadm 


is a finite (why?) m-continuous measure on M*. By Lemma 4, s is strongly 
regular. Also, as sf > 0 for any I € K, we certainly have 


To prove it, note that 


Ds > Ds > 0. 
(Why?) Now let 
(2) B= E"(Ds > 0) - UB 
where 
5) i 
(3) B, = E"(Ds > -), r=1,2.... 
Tr 


We have to show that m(B— A) = 0. 


Suppose 
m(B—A)>0 


Then by (2), we must have m(B, — A) > 0 for at least one B,; we fix this B,. 
Also, by (3), 


Ds > Z on B,-—A 
r 
(even on all of B,). Thus by Lemma 2, 
1 
(4) 0 < —m(B, — A) <3(B,- A) = f C4 dm. 
. B,-A 


But this is impossible. Indeed, as C4 = 0 on —A (hence on B, — A), the 
integral in (4) cannot be > 0. This refutes the assumption m(B— A) > 0; so 
by (2), = 

m(E” (Ds > 0) — A) =0; 


Le., 

Ds=0=Ds ae. on —A. 
We see that 

s' =0=C,4 ae.on —A, 
and 


eS 04. on A, 


proving the lemma for open sets A. 
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Now take any A € M*, mA < oo. As Lebesgue measure is regular (Chap- 
ter 7, §8, Theorem 3(b)), we find for each k € N an open set G, D A, with 


1 
m(G, i A) < ie and G;, > Grids 


Let 
Sk= [cc dm. 
Then s, \, s on M* (see Problem 5(ii) in §6). Also, by what was shown above, 


the s, are differentiable, with si, = Cg, a.e. 
Hence by Lemma 5, 


De= Ds= jim Ca, = Ca (ae.). 


The lemma is proved. 


Theorem 1. Let f: E” — E* (E", C") be m-integrable, at least on each cube 
in E”. Then the set function 
s= / fdm 


is differentiable, with s’ = f, a.e. on E”.? 


Thus s’ is the RN-derivative of s with respect to Lebesgue measure m 
(Theorem 1 in §11). 


Proof. As E” is a countable union of cubes (Lemma 2 in Chapter 7, §2), it 
suffices to show that s’ = f a.e. on each open cube J, with s differentiable 
a.e. on J. 

Thus fix such a J # @ and restrict s and m to 


Mo ={X €M*|X CJ}. 
This does not affect s’ on J; for as J is open, any sequence of cubes 


prope Td 


ah 


is a generalized measure in J; for Mo is a o-ring (verify!), and f is integrable 
on J. Also, m is strongly regular, and s is m-continuous. 


terminates inside J anyway. 
When so restricted, 


? Recall that J f is always defined by our convention. 
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First, suppose f is Mo-simple on J, say, 


q 
f=>_ «Cu, 
t=L 


say, with 0 < a; < oo, A; € M*, and 


qd 


J= U A; (disjoint). 


Then 


Hence by Lemma 6 above and by Theorem 1 in Chapter 7, §12, s is differen- 
tiable a.e. (as each f C4, is), and 


as required. 

The general case reduces (via components and the formula f = ft — f~) to 
the case f > 0, with f measurable (even integrable) on J. 

By Problem 6 in §2, then, we have f, 7 f for some simple maps f;, > 0. Let 


a= fh on Mo, k=1,2,.... 


Then all s;, and s = f f are finite measures and s;, / s, by Theorem 4 in §6. 
Also, by what was shown above, each s;, is differentiable a.e. on J, with si, = fr 
(a.e.). Thus as in Lemma 5, 


Ds = Ds=s' = jim o, = lif, = f (ae) otal, 


with s’ = f #+co (a.e.), as f is integrable on J. Thus all is proved. 


II. So far we have considered Lebesgue (K) differentiation. However, our re- 
sults easily extend to (-differentiation (Definition 2 in Chapter 7, §12). 

The proof is even simpler. Thus in Lemma 1, the union in formula (1) 
is countable (as K is replaced by the countable set family Q); hence it is 
p-measurable. In Lemma 2, the use of the Vitali theorem is replaced by 
Theorem 3 in Chapter 7, 812. Otherwise, one only has to replace Lebesgue 
measure m by ps on M. Once the lemmas are established (reread the proofs!), 
we obtain the following. 
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Theorem 2. Let S, p, Q, and uw: M — E* be as in Definition 2 of Chapter 
7, §12. Let f: S > E* (E", C™) be p-integrable on each AE M with wA < oo. 


Then the set function 
sf fay 


is Q-differentiable, with s’ = f, (a.e.) on S. 
Proof. Recall that $ is a countable union of sets Ut € Q with 0 < wU! < oo. 
As * is G-regular, each U! lies in an open set J? € M with 

pdt, < pt +6, < oo. 


Also, f is u-measurable (even integrable) on J‘. Dropping a null set, assume 
that f is M-measurable on J = J}. 


From here, proceed exactly as in Theorem 1, replacing m by wu. 


Both theorems combined yield the following result. 


Corollary 1. If s: M’ — E* (E", C’) is an m-continuous and m-finite gen- 
eralized measure in E”, then s is K-differentiable a.e. on E”, and ds = s'dm 
(see Definition 3 in 810) in any AE M* (mA < o).3 

Similarly for Q-differentiation. 


Proof. Given A € M* (mA < ov), there is an open set J D A such that 
mJ <mA+é< oo. 
As before, restrict s and m to 
Mop ={X EM*|XC J}. 


Then by assumption, s is finite and m-continuous on Mo (a o-ring); so by 


Theorem 1 in §11, 
s= [tam 


on Mo for some m-integrable map f on J. 
Hence by our present Theorem 1, s is differentiable, with s’ = f a.e. on J, 


and so 
s= [f= fs on Mo 


This implies ds = s’dm in A. 


For (-differentiation, use Theorem 2. 


3 The restriction mA < oo is redundant if s is finite. 
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Corollary 2 (change of measure). Let s be as in Corollary 1. Subject to Note 1 
in §10, if f is s-integrable on A € M* (mA < ov),* then fs’ is m-integrable 


on A and 
| fase f team. 
A A 


Similarly for Q-derivatives, with m replaced by ju. 


Proof. By Corollary 1, ds = s’dm in A. Thus Theorem 6 of §10 yields the 
result. 


Note 1. In particular, Corollary 2 applies to m-continuous signed LS mea- 
sures s = Sq in E! (see end of $11). If A = [a,b], then s, is surely finite on 
Sq-measurable subsets of A; so Corollaries 1 and 2 show that 


[fase =f tseam =f fo!am, 


since s’, = a’. (See Problem 9 in Chapter 7, §12.) 


Note 2. Moreover, s = Sq (see Note 1) is absolutely m-continuous iff a is 
absolutely continuous in the stronger sense (Problem 2 in Chapter 4, §8). 


Indeed, assuming the latter, fix ¢ > 0 and choose 6 as in Definition 3 of 
Chapter 7, §11. Then if mX < 6, we have 


X CU Jk (disjoint) 


for some intervals I, = (ax, by], with 


6> So mk = So (bx = ak). 


|sX|< > |sI;,| < e. 


Hence 


(Why?) Similarly for the converse.® 


Problems on Differentiation and Related Topics 
1. Fill in all proof details in this section. Verify footnote 4 and Note 2. 
2. Given a measure s: M! — E* (M’ DK), prove that 

(i) s is topological; 

(ii) its Borel restriction o is strongly regular; and 


(iii) Ds, Ds, and s’ do not change if s or m are restricted to the 
Borel field B in £"; neither does this affect the propositions on 
K-differentiation proved here. 


4 The restriction mA < oo is redundant if s is finite. 
5 Note that s{a} = 0 if s is m-continuous. 
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[Hints: (i) Use Lemma 2 of Chapter 7, §2. (ii) Use also Problem 10 in Chapter 7, 
87. (iii) All depends on K.] 


3. What analogues to 2(i)—(iii) apply to 0-differentiation in E”? In (S, p)? 
4. (i) Show that any m-singular measure s in E”, finite on K, has a zero 
derivative (a.e.). 
(ii) For Q-derivatives, prove that this holds if s is also regular. 


[Hint for (i): By Problem 2, we may assume s regular (if not, replace it by o). 
Suppose 
mE"(Ds >0)>a>0 


and find a contradiction to Lemma 2.] 


5. Give another proof for Theorem 4 in Chapter 7, 812. 
(Hint: Fix an open cube J € K. By Problem 2(iii), restrict s and m to 


Mo ={X €B|X CJ} 


to make them finite. Apply Corollary 2 in §11 to s. Then use Problem 4, Theorem 1 
of the present section, and Theorem 1 of Chapter 7, §12. 


For Q-differentiation, assume s regular; argue as in Corollary 1, using Corollary 2 
of §11.] 


6. Prove that if . 
Fo) =1 f fdm (a<2<b),° 
with f: E! = E* (E”, C”) m-integrable on A = [a,b], then F is differ- 


entiable, with F’ = f, a.e. on A. 
[Hint: Via components, reduce all to the case f > 0, Ff on A. 


Let 
s= | fam 


on M*. Let t = mf be the F-induced LS measure. Show that s = t on intervals in 
A; so s’ = t! = F” a.e. on A (Problem 9 in Chapter 7, §11). Use Theorem 1.] 


SHere Lf? fdm= Sta,2] f dm; m =Lebesgue measure. 


Chapter 9 
Calculus Using Lebesgue Theory 


§1. L-Integrals and Antiderivatives 


I. Lebesgue theory makes it possible to strengthen many calculus theorems. 
We shall start with functions on E!, f: E! > E. (A reader who has omit- 
ted the “starred” part of Chapter 8, §7, will have to set E = E*(E”, C”) 
throughout.) 

By L-integrals of such functions, we mean integrals with respect to Lebesgue 
measure m in E!. Notation: 


Lf sau f s@dent ae 


Lf’ r=-af's 


For Riemann integrals, we replace “L” by “R.” We compare such integrals 
with antiderivatives (Chapter 5, §5), denoted 


b 
[ft 
without the “L” or “R.” Note that 


L i f=5) ¢ 
[a,b] (a,b) 


etc., since m{a} = m{b} = 0 here. 


Theorem 1. Let f: E' > E be L-integrable on A = [a,b]. Set 


and 


H(e)=L ff, Ze A. 
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Then the following are true. 


(i) The function f is the derivative of H at any p € A at which f is finite 
and continuous. (Ata and b, continuity and derivatives may be one-sided 
from within.) 

(ii) The function H is absolutely continuous on A;' hence Vq[A] < 00.73 

Proof. (i) Let p € (a,b], q= f(p) # +c. Let f be left continuous at p; so, 
given € > 0, we can fix c € (a,p) such that 


|f(z) — q| < e for x € (c,p). 


Then 
ween) [Ef -ofsz fra 
<b f(e)=e-mle,r]=2(p—2). 
But " : 
tf g-g=2f s-2 fa 
tf a=a@-2), and 
bf san fs-2f's 
= H(p) — H(z) 
Thus 
|H(p) — H(z) —q(p—2)| <e(p—2); 
p-x 
Hence 


If f is right continuous at p € [a,b), a similar formula results for H‘/ (p). This 
proves clause (i). 


1 This is true even in the stronger sense, as in Problem 2 of Chapter 5, §8, or in §2 (nest 
to this). 

? Recall that Vy[A] is the total variation of H on A (Chapter 5, §§7-8). 

3 Part (ii) is true even if f is not L-integrable, only Lf | f| < co is needed. 
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(ii) Let e¢ > 0 be given. Then Theorem 6 in Chapter 8, §6, yields a 6 > 0 
such that 


(1) tf alse fuse 


whenever 
mX <dandADX, X EM. 


Here we may set 
7 


X = [J Ai (disjoint) 
for some intervals 


so that 


mx = So mA; = Sob 


Then (1) implies that 


conf ii=Def, 


_ = 7M) - H(as), 


Thus 
» |H(b;) — H(a;)| <e€ 
whenever 
So (bi _ a;) <6 
and 


AD | J(ai, bi) (disjoint). 


(This is what we call “absolute continuity in the stronger sense.” ) By Problem 2 
in Chapter 5, 88, this implies “absolute continuity” in the sense of Chapter 5, 
88, hence Vy[A] < oo. 


Note 1. The converse to (i) fails: the differentiability of H at p does not 
imply the continuity of its derivative f at p (Problem 6 in Chapter 5, §2). 

Note 2. If f is continuous on A — Q (Q countable), Theorem 1 shows that 
H is a primitive (antiderivative): H = [ f on A.* Recall that “Q countable” 


implies mQ = 0, but not Observe that we may always assume 
a,be Q. 


4 See Definition 1 in Chapter 5, §5. 
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We can now prove a generalized version of the so-called fundamental theorem 
of calculus, widely used for computing integrals via antiderivatives. 


Theorem 2. If f: E! — E has a primitive F on A = [a, bj, and if f is bounded 
on A—P for some P with mP = 0, then f is L-integrable on A, and 


(2) Lf f=fF(z)-F(a) foralize A. 


Proof. By Definition 1 of Chapter 5, 85, F is relatively continuous and finite 
on A = [a,b], hence bounded on A (Theorem 2 in Chapter 4, §8). 

It is also differentiable, with F’ = f, on A—Q for a countable set Q C A, 
with a,b € Q. We fix this Q along with P. 


As we deal with A only, we surely may redefine F and f on —A: 
F(a) ifa<a, 
F(x) = {9 | 
F(b) ifa>od, 
and f = 0 on —A. Then f is bounded on —P, while F' is bounded and 
continuous on E', and F’ = f on —Q;so F = f[ f on E12 
Also, forn =1,2,... andt € E!, set 


(3) fa(t) =n[F(t+-) - F()| = alee 


Then 


Ina F=f on —Q; 


ie., fn — f (a.e.) on E! (as mQ = 0). 

By (3), each f, is bounded and continuous (as F' is). Thus by Theorem 1 
of Chapter 8, §3, F and all f, are m-measurable on A (even on E'). So is f 
by Corollary 1 of Chapter 8, §3. 

Moreover, by boundedness, F' and f, are L-integrable on finite intervals. So 
is f. For example, let 


lfl<K<conA-P; 


as mP = 0, 


[itis [= K-ma<o 


proving integrability. Now, as 
1 
F = | f on any interval t,t + |, 
n 


5 See Definition 1 from Chapter 5, §5. 
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Corollary 1 in Chapter 5, §4 yields 
1 
(Vt E’) JF(e+ — | - F(t)| < sup |F’(t)| 


Hence 
lfn(t)| = n|F(t+ ~) — F(t)| < K; 


ie., |fn| < K for all n. 
Thus f and f,, satisfy Theorem 5 of Chapter 8, 86, with g = kK. By Note 1 


there, 
lim Lf fr= f qe 


In the next lemma, we show that also 


lim Lf fu= Flo) Fla) 


n— Co 


which will complete the proof. 


Lemma 1. Given a finite continuous F: E! — E and given fn as in (3), 
we have 


(4) lim Lf fn = F(x)— F(a) for allz € E’. 


n—- oo 


Proof. As before, F' and f, are bounded, continuous, and L-integrable on any 
[a, x] or [x,a]. Fixing a, let 


H(a)=1 | F, ce’. 
By Theorem 1 and Note 2, H = [ F also in the sense of Chapter 5, §5, with 


F = H' (derivative of H) on E'. 
Hence by Definition 2 the same section, 


[ P=H@)-H@=He@)-0-1f F; 
bf r=] F, 
Lf fuae=n [ r(es an [roar 


b+1/n x 
=nf P(t)dt—n f F(t) dt. 


+1/n 


1.€., 


and so 
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(We computed 
[Pes inyat 


by Theorem 2 in Chapter 5, §5, with g(t) =t+1/n.) Thus by additivity, 


x z+1/n x z+1/n atl1/n 
Lf fan f Fonf ranf Fon £, 
a at+1/n a x a 


a+1/n H(z+4 
nf = ( mn 


But 


Similarly, 
a+1/n 
lim nf = F(a). 


n—-Co 


This combined with (5) proves (4), and hence Theorem 2, too. 


We also have the following corollary. 


Corollary 1. If f: E' — E*(E”, C”) is R-integrable on A = [a,b], then 


(6) (V2 € A) nf t= Lf s= F(x) — F(a), 


provided F is primitive to f on A.® 


This follows from Theorem 2 by Definition (c) and Theorem 2 of Chap- 
ter 8, §9. 


Caution. Formulas (2) and (6) may fail if f is unbounded, or if F' is not 
a primitive in the sense of Definition 1 of Chapter 5, §5: We need F’ = f 
on A—Q, Q countable (mQ = 0 is not enough!). Even R-integrability (which 
makes f bounded and a.e. continuous) does not suffice if 


Fy | f 


Corollary 2. If f is relatively continuous and finite on A = [a,b] and has a 
bounded derivative on A—Q (Q countable), then f’ is L-integrable on A and 


For examples, see Problems 2-5. 


(7) i / “Peo 6@. forced. 


This is simply Theorem 2 with F, f, P replaced by f, f’, Q, respectively. 


6 We assumed that FE = E* (E”, C”) since R-integrals were defined for that case only. 
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Corollary 3. If in Theorem 2 the primitive 


pa] f 


(8) fay= So fo, EB. 


is exact on some B C A, then 


(Recall that F(z) is classical notation for F’(2).) 
Proof. By (2), this holds on B C A if F’ = f there. 


II. Note that under the assumptions of Theorem 2, 


Lf f=F@)-F@= ff. 


Thus all laws governing the primitive [ f apply to L [ f. For example, Theo- 
rem 2 of Chapter 5, §5, yields the following corollary. 


Corollary 4 (change of variable). Let g: E! — E' be relatively continuous on 
A = [a,b] and have a bounded derivative on A —Q (Q countable). 
Suppose that f: E! > E (real or not) has a primitive on g[A], exact on 


g|A—Q], and that f is bounded on g|A — Q}. 
Then f is L-integrable on g|A], the function 
(fog)g' 


is L-integrable on A, and 


b q 
(9) i / f(o(e)) 9! (e) de = L | f(y) dy, 


where p = g(a) and q = g(b). 


For this and other applications of primitives, see Problem 9. However, often 
a direct approach is stronger (though not simpler), as we illustrate next. 


Lemma 2 (Bonnet). Suppose f: E' > E' is > 0 and monotonically decreas- 
ing on A = [a,b]. Then, if g: E' — E' is L-integrable on A, so also is fg, 
and 


b c 
(10) Lf fo=fa)-L fg for some ce A. 


Proof. The L-integrability of fg follows by Theorem 3 in Chapter 8, §6, as f is 
monotone and bounded, hence even R-integrable (Corollary 3 in Chapter 8, §9). 
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Using this and Lemma 1 of the same section, fix for each n a C-partition 
Pe = {Ant = Loe Gn) 
of A so that 


(11) (Vn) 


Slr 


dn 

> a, Pr) = S(f, Pn) = Ss Wni MAni, 
i=1 

where we have set 

Wni = SUP f[Anil — inf Ff [Ani]. 


Consider any such P = {Aj}, 7 = 1,...,q (we drop the “n” for brevity). If 
A; = |ai-1, a;|, then since f|, 


wi = f(ai1) — fla) 2 |f(@) — flai-a)|, @ € Ai. 
Under Lebesgue measure (Problem 8 of Chapter 8, §9), we may set 
A; = [aj;_-1,a;] (V2) 
and still get 


(12) i. 
+ nf Me) faad)olw) ae 


(Verify!) Here ag = a and a, = b. 
Now, set 


Gia) =1 |g 


and rewrite the first sum (call it r or r,) as 


r= S- f(ai-1) [G(ai) — G(ai-1)| 


(13) r= ) G(a;) wi + G(b) fag). 
because f(a;_1) — f(a;) = w; and G(a) = 0. 


Now, by Theorem 1 (with H, f replaced by G,g), G is continuous on A = 
[a,b]; so G attains a largest value K and a least value k on A. 
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As f| and f > 0 on A, we have 
w; > 0 and f(ag_1) > 0. 
Thus, replacing G(b) and G(a;) by K (or &) in (13) and noting that 


> = F(a) — Faq-1), 
we obtain 
kf(a)<r<Kf(a); 
more fully, with k = minG[A] and kK = maxG{[A], 
(14) (Vn) kf(a)<tn< Kf(a). 
Next, let s (or rather s,,) be the second sum in (12). Noting that 
wi 2 |f(x) — f(ai-1)|, 


suppose first that |g| << B (bounded) on A. 
Then for all n, 


dn dn 
al SL | (Wns B)= BY wri mAns <0. (by (11). 
i=1 0 V Ani 


i=1 
But by (12), 


Lf fo] 4k. (FR): 
A 
As 8, — 0, 
L| fg = lim ry, 
A n—co 
and so by (14), 
kf(a) < L - fo < Kf (a). 


By continuity, f(a)G(x) takes on the intermediate value LJ, fg at some 
c € A; so 


bf ta= sa) Go) = Foe f ee 


ca)=L ff. 


Thus all is proved for a bounded g. 


The passage to an unbounded g is achieved by the so-called truncation 
method described in Problems 12 and 13. (Verify!) 


366 Chapter 9. Calculus Using Lebesgue Theory 


Corollary 5 (second law of the mean). Let f: E' — E! be monotone on 
A= [a,b]. Then if g: E' — E' is L-integrable on A, so also is fg, and 


b c b 
(15) Lf fo= sa) | 9+ f0)L fg for some c€ A. 
Proof. If, say, f| on A, set 
h(x) = f(x) — f(0). 
Then h > 0 and h| on A; so by Lemma 2, 


Cc 


b 
[ n=nae fg for some c € A. 


a 


As 


this easily implies (15). 
If ff, apply this result to —f to obtain (15) again. 


Note 3. We may restate (15) as 


b c b 
dce€ A) L| fo=pL | g+al | 9; 
provided either 


(i) ff and p< f(at+) < f(b-) <4, or 
(ii) fl and p> f(at+) 2 f(b-) 24. 
This statement slightly strengthens (15). 


— 
ul 


To prove clause (i), redefine 
f(a) =p and f(b) =4¢. 


Then still f7; so (15) applies and yields the desired result. Similarly for (ii). 
For a continuous g, see also Problem 13(ii’) in Chapter 8, §9, based on Stieltjes 
theory. 


III. We now give a useful analogue to the notion of a primitive. 
Definition. 


A map F: E! — E is called an L-primitive or an indefinite L-integral of 
f: E' = E, on A= (a, iff f is L-integrable on A and 


(16) Fle)=et ff 


for all x € A and some fixed finite c € E. 
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F=f f (not r= [ 1) 


F(e)=L | fa)ae ae 


Notation: 


or 


By (16), all L-primitives of f on A differ by finite constants only. 

If E = E*(E£”", C”), one can use this concept to lift the boundedness re- 
striction on f in Theorem 2 and the corollaries of this section. The proof will 
be given in 82. However, for comparison, we state the main theorems already 
now. 


“Theorem 3. Let 
Pau f on A =|[a, | 
for some f: E) — E* (E”, C™). 
Then F is differentiable, with 
F’=f ae.onaA. 


In classical notation, 


(17) jae “ Lf f(t)dt for almost all x € A. 


A proof was sketched in Problem 6 of Chapter 8, §12. (It is brief but requires 
more “starred” material than used in §2.) 


*Theorem 4. Let F: E' — E"(C”) be differentiable on A = [a,b] (at a and 
b differentiability may be one sided). Let F’ = f be L-integrable on A. 
Then 


(18) Lf f=F@)-F@ for alla € A. 


Problems on L-Integrals and Antiderivatives 


1. Fill in proof details in Theorems 1 and 2, Lemma 1, and Corollaries 1-3. 
1’. Verify Note 2. 
2. Let F’ be Cantor’s function (Problem 6 in Chapter 4, §5). Let 


G= Gri 
kt 


(G;; as in that problem). So [0,1] - G = P (Cantor’s set); mP = 0 
(Problem 10 in Chapter 7, §8). 
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Show that F is differentiable (F’ = 0) on G. By Theorems 2 and 3 


of Chapter 8, 89, 
1 1 
ca Fai | F=f Fro 
0 0 é: 
(0) 


exists, yet F(1) — F(0) =1-00. 
Does this contradict Corollary 1? Is F' a genuine antiderivative of f? 
If not, find one. 


3. Let 
0 on (0,24), and 
po{o ole 
Te om [541] 
Show that 
1 
rf F’=0 
0 
exists, yet 


What is wrong? 


[Hint: A genuine primitive of F’ (call it ¢) has to be relatively continuous on [0, 1]; 
find ¢ and show that ¢(1) — ¢(0) = 0.] 


4. What is wrong with the following computations? 


1 
d 1 

(ii) Lf ae In a = 0. Is there a primitive on the whole 
ae =| 


interval? 
[Hint: See hint to Problem 3.] 


1 
(iii) How about L . ee (cf. examples (a) and (b) of Chap- 


-_1 & 
ter 5, §5)? 


5. Let 


Prove the following: 
(i) F is differentiable on A = [0,1]. 
(ii) f = F’ is bounded on any |a,b] C (0,1), but not on A. 
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(iii) Let 
2 1 
n= ————— 4 = fi aa Beer 
a eee Jin or n 
Show that 
AD U [an, bn] (disjoint) 
n=1 
and 
b 
mn 1 
L — 
a = 
so 


b oo 
1 
EB) get} (oe Se 
a Us lane) > 2n 


and f = F” is not L-integrable on A. 
What is wrong? Is there a contradiction to Theorem 2? 


6. Consider both 
=e sin x 


(a) f(z) = f(0) =1, and 


’ 
x 


(b) fe) =, fo =. 


In each case, show that f is continuous on A = [0,1] and 


Rf f<1 


exists, yet it does not “work out” via primitives. What is wrong? Does 
a primitive exist? 
To use Corollary 1, first expand sinxz and e~* in a Taylor series and 
find the series for 
ji 


Rf 


approximately, to within 1/10, using the remainder term of the series to 
estimate accuracy. 


[Hint: Primitives exist, by Theorem 2 of Chapter 5, §11, even though they are none 
of the known “calculus functions.” | 


by Theorem 3 of Chapter 5, 89. 
Find 
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7. Take A, G, = (an, bn), and P (mP > 0) as in Problem 17(iii) of Chap- 
ter 7, 88. 
Define F’' = 0 on P and 
1 
(bn — On)(& — Gn) (x — by) 


Prove that F has a bounded derivative f, yet f is not R-integrable on 
A; so Theorem 2 applies, but Corollary 1 does not. 
[Hints: If p ¢ P, compute F’(p) as in calculus. 


F(x) = (a — an)*(x — by)? sin iar? PP. 


If p € P and x > p+ over A— P, then z is always in some (an, bn), p< an < &. 
(Why?) Deduce that Ax = x — p> 2 — apy and 


Pe 


Ae < (x@—an)(b aj? < |Aa|(b — a); 


so F‘ (p) = 0. (What if  — p+ over P?) Similarly, show that F’ =0 on P. 


Prove however that F'(x) oscillates from 1 to —1 as x > an+ or x — bn—, hence 
also as 2 — p € P (why?); so F” is discontinuous on all of P, with mP > 0. Now 
use Theorem 3 in Chapter 8, §9.] 


=8. If 


QC A= a, d] 
and mQ = 0, find a continuous map g: A — E!, g > 0, gt, with 
g =+oo ond. 
(Hints: By Theorem 2 of Chapter 7, §8, fix (Vn) an open Gn D Q, with 
MmGn <27~". 


Set 
gn(x) = M(Gn N [a, z]) 


and 


ioe) 
9= Di 9 
n=1 


on A; >> gn converges uniformly on A. (Why?) 
By Problem 4 in Chapter 7, §9, and Theorem 2 of Chapter 7, §4, each gn (hence 
g) is continuous. (Why?) If [p,z] C Gn, show that 


gn(«) = gn(p) + (x — p), 


sO 


and 


§1. L-Integrals and Antiderivatives 371 


9. 


=10. 


=>11. 


(i) Prove Corollary 4. 


(ii) State and prove earlier analogues for Corollary 5 of Chapter 5, §5, 
and Theorems 3 and 4 from Chapter 5, §10. 


[Hint for (i): For primitives, this is Problem 3 in Chapter 5, §5. As g[Q] is countable 
(Problem 2 in Chapter 1, §9) and f is bounded on 


g{A] — 9[Q] € g[A- Q], 
f satisfies Theorem 2 on g[A], with P = g[Q], while (f 0g) g’ satisfies it on A.] 
Show that if h: E' — E* is L-integrable on A = [a,b], and 


(Va € A) L| h=0, 
then h = 0 a.e. on A. 


[Hints: Let K = A(h > 0) and H = A — K, with, say, mK =e > 0. 
Then by Corollary 1 in Chapter 7, §1 and Definition 2 of Chapter 7, 85, 


H C|JBn (disjoint) 


n 


for some intervals By, C A, with 


So mBn <mH +¢=mH +mK =mA. 


(Why?) Set B=U,, Bn; so 


(for L fh =0 on intervals Bn). Thus 
fo r=fa-f[nqo 
A-B A B 


A-BCA-H=K, 


But BD H; so 


where h > 0, even though m(A — B) > 0. (Why?) 

Hence find a contradiction to Theorem 1(h) of Chapter 8, §5. Similarly, disprove 
that mA(h <0) =e>0.] 
Let Ft on A = [a, d], |F'| < co, with derived function F’ = f. Taking 
Theorem 3 from Chapter 7, §10, for granted, prove that 


Lf F< Fle)- Foo) eA, 


[Hints: With f, as in (3), F and f, are bounded on A and measurable by Theorem 1 
of Chapter 8, §2. (Why?) Deduce that fn — f (a.e.) on A. Argue as in Lemma 1 
using Fatou’s lemma (Chapter 8, §6, Lemma 2).] 
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12. (“Truncation.”) Prove that if g: S — E is m-integrable on A € M 
in a measure space (S,M,m), then for any < > 0, there is a bounded, 
M-measurable and integrable on A map go: S — EF such that 


| \g-solam <e. 
A 


[Outline: Redefine g = 0 on a null set, to make g M-measurable on A. Then for 
n=1,2,... set 


_ J g on A(|g| <n), and 
clas 0 elsewhere. 


(The function gy, is called the nth truncate of g.) 
Each gn is bounded and M-measurable on A (why?), and 


/ |g] dm < co 
A 


by integrability. Also, |gn| < |g| and gn — g (pointwise) on A. (Why?) 
Now use Theorem 5 from Chapter 8, 86, to show that one of the gn may serve as 
the desired go.| 


13. Fill in all proof details in Lemma 2. Prove it for unbounded g. 
[Hints: By Problem 12, fix a bounded go (|go| < B), with 


E 


if 
Lf Io 91 < 3 Fay — FO) 


Verify that 


dn 
nls of wall < df wnilgol +d f Wnilg — Jol 
j=1 2 Ani i Ani GY Ani 


For all n > 2/e, we get |sn| < te + te =e. Hence s, — 0. Now finish as in the 
text.] 


14. Show that Theorem 4 fails if F’ is not differentiable at some p € A. 
[Hint: See Problems 2 and 3.] 


§2. More on L-Integrals and Absolute Continuity 


I. In this section, we presuppose the “starred” 810 in Chapter 7. First, how- 
ever, we add some new ideas that do not require any starred material. The 
notation is as in §1. 
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Definition 1. 
Given F: E! — E,p € E', and q € E, we write 


q~ DF(p) 
and call q an F'-derivate at p iff 


F — fF 
pie eS) 
k00 = LR — P 
for at least one sequence x, > p (xp # p).+ 


If F' has a derivative at p, it is the only F-derivate at p; otherwise, 
there may be many derivates at p (finite or not). 


Such derivates must exist if E = E' (E*). Indeed, given any p € E!, let 


1 
bi Pa Di 
let i _ 
Yk = (e) (P) a ees 
Lk — Pp 


By the compactness of E* (Chapter 4, §6, example (d)), {y,} must have a 
subsequence {yz, } with a limit q € E* (e.g., take q = lim y,), andsog ~ DF(p). 
We also obtain the following lemma. 


Lemma 1. /f F: E' — E* has no negative derivates on A—Q, where A = 
[a,b] and mQ = 0, and if no derivate of F on A equals —oo, then Ft on A. 


Proof. First, suppose F’ has no negative derivates on A at all. Fix « > 0 
and set 
G(x) = F(x) + ex. 


Seeking a contradiction, suppose a < p< q < b, yet G(q) < G(p). Then if 


1 
r= 5(+4), 


one of the intervals [p,7r] and |r, q] (call it [p1, qi]) satisfies G(qi) < G(p1). 
Let 


1 
is Ge 5 (1 + q). 
Again, one of [pi,71] and [ri,q1] (call it [p2, q2]) satisfies G(q2) < G(p2). Let 
1 
c= 5 (2 + qa), 
and so on. 


1 “DF (p)” stands for “an F-derivate at p.” 
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Thus obtain contracting intervals [p,, qn], with 
Glin) < Gin) =H 1 2yw 
Now, by Theorem 5 of Chapter 4, §6, let 


Po € { \ [Pas nl: 


n=1 
Then set 2p = dn if G(dn) < G(po), and 2» = pn otherwise. Then 


G(tn) — G(po) 2 
Ln — Po 


0 


and t%» — po. By the compactness of E*, fix a subsequence 


G(an,) — G(Po) 


Cnz — Po 


>ce EB’, 


say. Then c < 0 is a G-derivate at p, € A. 


But this is impossible; for by our choice of G and our assumption, all 
derivates of G are > 0. (Why?) 
This contradiction shows that a < p < q < b implies G(p) < G(q), ie., 


PQ) reps Pa) eg: 


Making ¢ — 0, we obtain Fp) < F(q) whena<p<q<0b,ie., Ff on A. 
Now, for the general case, let Q be the set of all p € A that have at least 
one DF (p) < 0; so mQ = 0. 
Let g be as in Problem 8 of §1; so g’ = 00 on Q. Given € > 0, set 


G=F+eg. 
As gt, we have 
— F(«x)-F 
ve.pe a) G=EO) , F@)- FO) 
t—p wv — p 


Hence DG(p) > 0 ifp €Q. 

If, however, p € Q, then g/(p) = oo implies DG(p) > 0. (Why?) Thus all 
DG(p) are > 0; so by what was proved above, GJ on A. It follows, as before, 
that F'} on A, also. The lemma is proved. 


We now proceed to prove Theorems 3 and 4 of §1. To do this, we shall need 
only one “starred” theorem (Theorem 3 of Chapter 7, §10). 


Proof of Theorem 3 of §1. (1) First, let f be bounded: 
lfl<K onA. 
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Via components and by Corollary 1 of Chapter 8, §6, all reduces to the real 
positive case f >0 on A. (Explain!) 
Then (Theorem 1(f) of Chapter 8, 85) a< x < y < b implies 


bf rsuf's, 


ie., F(x) < F(y); so FT and F’ >0 on A. 
Now, by Theorem 3 of Chapter 7, 810, F' is a.e. differentiable on A. Thus 
exactly as in Theorem 2 in 81, we set 


Since all f,, are m-measurable on A (why?), so is F’. Moreover, as |f| < K, 
we obtain (as in Lemma 1 of §1) 


ifn(a)| = n(z fo <n Ker. 


Thus by Theorem 5 from Chapter 8, 86 (with g = K), 


Lf P= tim Z f f= ff 


(Lemma 1 of $1). Hence 


Lf (F=f) =0, Le A, 


and so (Problem 10 in §1) F’ = f (a.e.) as claimed. 
(2) If f is not bounded, we still can reduce all to the case f > 0, f: E! — E*, 
so that Ft and F’ > 0 on A. 


If so, we use “truncation”: For n = 1,2,..., set 


; =e on A(f <n), and 


0 elsewhere. 


Then (see Problem 12 in §1) the g, are L-measurable and bounded, hence L- 
integrable on A, with g, — f and 


O<m<f 
on A. By the first part of the proof, then, 


d x 
zt n= Oy ae. oF Ay WH 1,2..44. 
ae J 
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Also, set (V7) 
Fy(0)=L f (f-99) 20: 
so F;, is monotone (}) on A. (Why?) 


Thus by Theorem 3 in Chapter 7, §10, each F,, has a derivative at almost 
every x € A, 


F(a =£(zf 9- Lf m) = F"(x) —gn(z)>0 ae. on A. 


Making n — oo and recalling that g, — f on A, we obtain 
F’(x)— f(x) >0 ae. on A. 
Thus 
Lf (r= p20. 


But as F'T (see above), Problem 11 of §1 yields 


Lf F's F(a)- Fa@)=Lf fi 
Lf wnat [r- Lf so. 


Combining, we get 


sO 


(Vx € A) Lf (F=f) =6: 


so by Problem 10 of 81, F’ = f a.e. on A, as required. 


Proof of Theorem 4 of 81. Via components, all again reduces to a real f.? 
Let (Vn) 
“. on A(f <n), 
2 NO: oh A fem); 


80 Gn — f (pointwise), gn < f, gn <n, and |gn| < |fl. 
This makes each g, L-integrable on A. Thus as before, by Theorem 5 of 
Chapter 8, §6, 


(1) tim Lf m=1 | f, Zea. 


l— CO 
Now, set 


ae ee Lf dh 


2 Not f > 0, though, since Corollary 1 in Chapter 8, 86, does not apply to differentiation. 
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Then by Theorem 3 of §1 (already proved), 


F(z) = F'(2) — Zt fa = f(z)—gn(x)>0 ae.onA 


(since gn < f). 
Thus F;, has solely nonnegative derivates on A — Q (mQ = 0). Also, as 


Gn <1, we get 
1 Ba 
L| Gn <N, 
«— Dp a 


even if x < p. (Why?) Hence 


as 


Thus none of the F,,-derivates on A can be —oo. 
By Lemma 1, then, F;, is monotone (7) on A; so F,,(x) > Fy (a), ie., 


Fa) f m2 F@-L fo = Flo) 


or 


Hence by (1), 
F(z) — F(a) >1 | f; Zea. 


For the reverse inequality, apply the same formula to —f. Thus we obtain the 
desired result: 


(2) F(a) = F(a) +h ff for 2 € A. 


Note 1. Formula (2) is equivalent to F = L [ f on A (see the last part of 
81). For if (2) holds, then 


Fa)=erL ff, 


with c= F(a);so F=L f f by definition. 
Conversely, if 


Fa)=e+L | f, 


set x = a to find c= F(a). 
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II. Absolute continuity redefined. 
Definition 2. 


A map f: E! = E is absolutely continuous on an interval I C E! iff for 
every € > 0, there is 6 > 0 such that 


r 


So (bi —aj;) < 6 implies S> | f(b) — f(a)| <e 


i=1 i=1 
for any disjoint intervals (a;,b;), with a;,b; € I. 
From now on, this replaces the “weaker” definition given in Chapter 5, §8. 
The reader will easily verify the next three “routine” propositions. 


Theorem 1. If f,g,h: E' — E*(C) are absolutely continuous on A = {a, b], 
so are 


fxg, hf, and |f\. 
So also is f/h if 


“——~ 


de>0) |h| Se on A. 


All this also holds if f,g: E! — E are vector valued and h is scalar valued. 
Finally, of E C E*, then 
fvg, fAg, f*, and f~ 
are absolutely continuous along with f and g. 


Corollary 1. A function F: E! — E"(C™) is absolutely continuous on A = 
[a,b] iff all its components F,,...,F, are. 

Hence a complex function F: E‘ — C is absolutely continuous iff its real 
and imaginary parts, Fy. and Fim, are. 


Corollary 2. If f: E! — E is absolutely continuous on A = [a,b], it is 
bounded, is uniformly continuous, and has bounded variation, V|a,b] < 00, 
all on A. 


Lemma 2. If F: E! — E"(C”) is of bounded variation on A = [a,b], then 
(i) F is a.e. differentiable on A, and 
(ii) F’ is L-integrable on A. 
Proof. Via components (Theorem 4 of Chapter 5, §7), all reduces to the real 
case, F: E1 > E}. 
Then since Vr|A] < co, we have 
F=g-h 


for some nondecreasing g and h (Theorem 3 in Chapter 5, §7). 
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Now, by Theorem 3 from Chapter 7, 810, g and Ah are a.e. differentiable on 
A. Hence so is 
g-h=F. 


Moreover, g’ > 0 and h’ > 0 since gf and hf. 
Thus for the L-integrability of F’, proceed as in Problem 11 in 81, i.e., show 
that F’ is measurable on A and that 


b b b 
L| | | hi 


is finite. This yields the result. 


Theorem 2 (Lebesgue). If F: Et — E"(C”) is absolutely continuous on 
A =|[a,)], then the following are true: 


(i*) F is a.e. differentiable, and F’ is L-integrable, on A. 
(ii*) If, in addition, F’ =0 a.e. on A, then F is constant on A. 
Proof. Assertion (i*) is immediate from Lemma 2, since any absolutely con- 


tinuous function is of bounded variation by Corollary 2. 
(ii*) Now let F’ =0 ae. on A. Fix any 


B=[a,c] CA 


and let Z consist of all p € B at which the derivative F’ = 0. 
Given € > 0, let K be the set of all closed intervals [p, x], p < x, such that 


AF F — 
| = | (x) ~F(R)| 
Ax L—p 
By assumption, 
AF 
lim — =0 EZ), 
lim = (p € Z) 
and m(B — Z) =0; B= |a,c] € M*. If p € Z, and x — p is small enough, then 
AF 2 
Ar|~” 


ie., [p,z] € K. 
It easily follows that K covers Z in the Vitali sense (verify!); so for any 
6 > 0, Theorem 2 of Chapter 7, 810 yields disjoint intervals 


Tp = [Pk, Tx] = K, Ty, Cc Bb, 


with 


qd 
m(z- U ie) <6, 
k=1 
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m(B- Un) <1) 


k=1 


hence also 


(for m(B — Z) = 0). But 


3 a 
B-|Jh=lad- ibe 
k=1 


kai 
pa 
[a, p1) ut [tee ) Ul wave] il op < De <1) 


sO 


(3) m(B - Un) = i) + Sime) 4 + (c— 24) <6. 


Now, as F' is absolutely continuous, we can choose 6 > 0 so that (3) implies 


(4) |F(p1) — F@)| + % |F (peti) — F(te)| + |F(Q — F@q)| <€- 


k=1 
But J; € K also implies 
|F'(x~) — F(pp)| < €(a~ — pe) = €- mI. 


Hence 


S-lF (2x) — F(px)]| < eS mk <e-mB=e(c—p). 


q | q 
k=1 k=1 


Combining with (4), we get 


|F(c) — F(a)| < e(1+c-—a) > 0 ase — 0; 


so F(c) = F(a). Asc € A was arbitrary, F is constant on A, as claimed. 


Note 2. This shows that Cantor’s function (Problem 6 of Chapter 4, §5) is 
not absolutely continuous, even though it is continuous and monotone, hence 
of bounded variation on [0,1]. Indeed (see Problem 2 in 81), it has a zero 
derivative a.e. on [0,1] but is not constant there. Thus absolute continuity, as 
now defined, differs from its “weak” counterpart (Chapter 5, §8). 


Theorem 3. A map F: E! => E'(C”) is absolutely continuous on A = 
[a,b] aff 


P=Lff on A 
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for some function f;? and then 
F(a) = F(a) +1 f i. @2A, 


Briefly: Absolutely continuous maps are exactly all L-primitives. 


Proof. If F=L f f, then by Theorem 1 of §1, F' is absolutely continuous on 
A, and by Note 1, 


F(a) = F(a +t ff ze A, 


Conversely, if F' is absolutely continuous, then by Theorem 2, it is a.e. dif- 
ferentiable and F’ = f is L-integrable (all on A). Let 


=i] ie @E A, 


Then H, too, is absolutely continuous and so is F — H. Also, by Theorem 3 
of 81, 
H!=f=F’, 


and so 
(F—H)'=0 ae. on A. 


By Theorem 2, F — H = c; ie., 
F(x) =c+ H(2) =e+n | if. 


and so F = L { f on A, as claimed. 


Corollary 3. If f,F: E' > E* (E”, C”), we have 


F= Lf 


on an interval I C E! iff F is absolutely continuous on I and F' = f a.e. on I. 
(Use Problem 3 in §1 and Theorem 3.) 


Note 3. This (or Theorem 3) could serve as a definition. Comparing ordi- 


nary primitives 
r=[f 


F=f f, 


3 Such as F’, the derived function of F. 


with L-primitives 
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we see that the former require F’ to be just relatively continuous but allow only 
a countable “exceptional” set Q, while the latter require absolute continuity 
but allow Q to even be uncountable, provided mQ = 0. 

The simplest and “strongest” kind of absolutely continuous functions are 
so-called Lipschitz maps (see Problem 6). See also Problems 7 and 10. 


III. We conclude with another important idea, due to Lebesgue. 
Definition 3. 
We call p € E! a Lebesgue point (“L-point”) of f: E! — E iff 
(i) f is L-integrable on some G'‘,(6); 
(ii) q¢ = f(p) is finite; and 


(iii) hm oe |f —q| =0. 


rp Xv 


The Lebesgue set of f consists of all such p. 
Corollary 4. Let 
FaLff on A =|[a, b}. 


Ifp € A is an L-point of f, then f(p) is the derivative of F at p (but the 
converse fails). 


Proof. By assumption, 


Fla)=e+h ff, xz € G,(d), 


uf r-al< age f it-al—o 


as x — p. (Here q = f(p) and Ax = x — p.) 


and 
1 


|Az| 


Thus with x — p, we get 


FoF) ‘| = a Lf F-@- mg 


cp 
1 x x 

=e fs-2 foe 
ep] p p 


Corollary 5. Let f: E! = E"(C"). Then p is an L-point of f iff it is an 
L-point for each of the n components, fi,.-.,fn, of f. 


as required. 


(Exercise!) 
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Theorem 4. [f f: E' — E*(E", C”) is L-integrable on A = [a,b], then 
almost all p € A are Lebesgue points of f. 
Note that this strengthens Theorem 3 of 81. 


Proof. By Corollary 5, we need only consider the case f: E! — E*. 
For any r € E', |f —r| is L-integrable on A; so by Theorem 3 of §1, setting 


Fo) =f if=rl 


we get 


(5 Fi(p) = kim 


Lf \f=ri= ls) =r 


for almost all p € A. 
Now, for each r, let A, be the set of those p € A for which (5) fails; so 
mA, =0. Let {rg} be the sequence of all rationals in E1. Let 


Q= UL Ar, U {4,8} U Aco, 
k=1 


where 


Aw = A(|f] = 00); 


so mQ = 0. (Why?) 
To finish, we show that all p € A—@Q are L-points of f. Indeed, fix any 
p€ A-—Q and anye> 0. Let q= f(p). Fix a rational r such that 


la-rl< 5. 
Then 
If -rl-If all <|(f-r)-(f-a| =la-rl<5 on A— Ago. 


Hence as mA, = 0, we have 


© ef r-n-2fr-al<e [(§) = Gle-o 
Since 


p€Q2UAn, 
k 


formula (5) applies. So there is 6 > 0 such that |x — p| < 6 implies 


eae [us rl) =F) <r 


a 
3 
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we get 


Hence 
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If) - rl =la-rl <5, 


1 7 1 i 
sa! [Fors (a2/ fel) = lar) + lea 
eS ,€ ~2e 
a ha 


- 2€ 
Lf \f-r< Fle~ol 
p 


Combining with (6), we have 


poptf U-a<§+ Fae 


whenever |x — p| < 6. Thus 


as required. 


an 
=>3. 


=>6. 


Problems on L-Integrals and Absolute Continuity 


. Fill in all details in the proof of Lemma 1 and of Theorems 3 and 4 


from 81. 


. Prove Theorem 1 and Corollaries 1, 2, and 5. 


Disprove the converse to Corollary 4. (Give an example!) 


Show that if F: E! — E is L-integrable on A = [a,b] and continuous at 
p€A, then p is an L-point of F. 
[Hint: Use the e, 6 definition of continuity.] 


. Complete all proof details for Lemma 2, Theorems 3 and 4, and Corol- 


lary 3. 


. Let F =10n R (= rationals) and F = 0 on E! — R (Dirichlet function). 


Show that F' has exactly three derivates (0, +00, and —co) at every 
pe E}. 


We say that F' is a Lipschitz map, or has the uniform Lipschitz property 
on A, iff 


(AK €E') (V2,yeA) |F(2)- FY) < Klz—-y. 
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Prove the following: 


(i) Any such F’ is absolutely continuous on A = [a, }]. 


(ii) If all derivates of f satisfy 
IDf(a)|<k<oo, ce A=[a,d], 
then f is a Lipschitz map on A. 


=>7. Let g: E' = E' and f: E! — E (real or not) be absolutely continuous 
on A = [a,b] and g[A], respectively. 
Prove that h = f og is absolutely continuous on A, provided that 
either f is as in Problem 6, or g is strictly monotone on A. 


8. Prove that if F: E' — E! is absolutely continuous on A = [a,b], if 
Q C A, and if mQ = 0, then m*F|Q] = 0 (m = Lebesgue measure). 
[Outline: We may assume Q C (a,b). (Why?) 

Fix ¢ > 0 and take 6 as in Definition 2. As m is regular, there is an open G, 


QC GC (a,b), 
with mG < 6. By Lemma 2 of Chapter 7, §2, 
G= |J Ik (disjoint) 
k=1 


for some I, = (ax, dx]. 
Let uz = inf F[J,], vp = sup FI]; so 


FI] [ux ve] 
and 
m* F [Ip] < Uk — Uk- 
Also, 


From Definition 2, show that 
co 
Se = Uk) < é 


(first consider partial sums). As 
FIQ)C FIG) CU Fuel, 
k 


get 
m* F[Q] < S > m* Fle] = Si (vr — up) <e> 0] 


k k 
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9. 


=10. 


11. 
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Show that if F’ is as in Problem 8 and if 
A= [a,b] > B, Be M* 
(L-measurable sets), then 
F[B] e M*. 


(“F preserves M*-sets.” ) 
[Outline: (i) If B is closed, it is compact, and so is F[B] (Theorems 1 and 4 of 
Chapter 4, §6). 
(ii) If B € Fo, then 
B=| JB), Beer 
so by (i), 
F[B] =|_JFIBi] € Fo CM". 


(iii) If B € M*, then by Theorem 2 of Chapter 7, §8, 


(AK € Fo) KCB, m(B—K)=0. 
Now use Problem 8, with Q = B— K.] 


(Change of variable.) Suppose g: E! > E' is absolutely continuous and 
one-to-one on A = [a,b], while f: E1 — E*(E”, C”) is L-integrable 
on g[A]. 

Prove that (f og) g’ is L-integrable on A and 


Lf trona'=2 fs 


where p = g(a) and q = g(b). 
[Hints: Let F = Lf f and H=Fogon A. 

By Theorems 2 and 3 and Problem 7 (end), F' and H are absolutely continuous 
on g[A] and A, respectively; and H’ is L-integrable on A. So by Theorem 3, 


H=LfH'=2 f[(foas’ 
as H’ = (f og)g’ ae. on A_] 


Setting f(x) = 0 if not defined otherwise, find the intervals (if any) on 
which f is absolutely continuous if f(a) is defined by 


(a) sina; 
(b) cos 2a; 
(c) 1/a; 
(d) tana; 
(e) 
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(f) xsin(1/z); 

(g) x*sina~? (Problem 5 in §1); 

(h) V3 - sin(1/z) (verify that | f’(x)| < 3 +272). 
[Hint: Use Problems 6 and 7.] 


§3. Improper (Cauchy) Integrals 


Cauchy extended R-integration to unbounded sets and functions as follows. 
Given f: E! — E and assuming that the right-hand side R-integrals and 
limits exist, define (first for oe sets, then for unbounded functions) 


vfs =f f=imef f: 
(i [ot-f team a 


If both 0 
| f and i f 
0 —oo 


[. f= I. a es ‘ 


Now, suppose f is unbounded near some p € A = |{a, b], i.e., unbounded on 


ANG-p 


exist, define 


for every deleted globe G_, about p (such points p are called singularities). 
Then (again assuming existence of the R-integrals and limits), we define 


(1) in case of a singularity p = a, 


b 
| fef f= lim nf f 
a+ (a,b x—a+ 


[=f tee e fs 


(3) ifa<p< band if 
p- b 
| fand | f 
a pt 


(2) if p= 6, then 
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eee: 
Lae 


is necessary if RS- or LS-integrals are used.' 


exist, then 


The term 


Finally, if A contains several singularities, it must be split into subintervals, 
each with at most one endpoint singularity; and f° f is split accordingly.” 

We call all such integrals improper or Cauchy (C) integrals. A C-integral is 
said to converge iff it exists and is finite. 

This theory is greatly enriched if in the above definitions, one replaces R- 
integrals by Lebesgue integrals, using Lebesgue or LS measure in E+. (This 
makes sense even when a Lebesgue integral (proper) does exist; see Theorem 1.) 
Below, m shall denote such a measure unless stated otherwise. 


C-integrals with respect to m will be denoted by 
C / fdm, C f, ete. 
a [a,b) 


“Classical” notation: 
cf f2)am(c) or cf #2) dx 


(the latter ifm is Lebesgue measure). We omit the “C” if confusion with proper 
integrals fe f is unlikely. 


Note 1. C-integrals are limits of integrals, not integrals proper. Yet they 
may equal the latter (Theorem 1 below) and then may be used to compute 
them. 

Caution. “Singularities” in [a,b] may affect the primitive used in compu- 
tations (cf. Problem 4 in $1). Then [a,b] must be split (see above), and oa - 
splits accordingly. (Additivity applies to C-integrals; see Problem 9, below.) 
Examples. 


(A) The integral 
172 
fe 
-_j @«& 


' For RS- and LS-integrals, we may well have iC f #9, Sia b] fF hie b) f, etc. 
? This also applies if an infinite interval has an inside singularity. 
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has a singularity at 0. By Theorem 1 below,® we get 


a ey ee ge 
-, 2 fy 2? oe, SE 
1 


= lim (-=-1)+ lim (-2+-) co + 00 = CO 
x—0— x x—0+ 
(B) We have 
~° dx 
st= hi ——+2)=2 
i: x? Jim ( a ) 
Hence 
1/2 oo 
of anc} S ae ee ee 
1 v rae 


(C) The integral 


389 


has no singularities (consider deleted globes about 0). The primitive 


F(x) = |x| exists (example (b) in Chapter 5, §5); so 


Lf Fl ge = el). = 
oe. =i 
In the rest of this section, we state our theorems mainly for 
cfs 
but they apply, with similar proofs, to 
C [. f, C etc. 


The measure m is as explained above. 
Theorem 1. Let A= [a,oo), f: E' — E (E complete). 
(i) If f => 0 on A, then < 
C i; fdm 


ie fdm4 


exists (< oo) and equals 


3 Tt applies to finite intervals A, too. 
4 That is, the proper integral. 
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(ii) The map f is m-integrable on A iff 


cf fl <oo 


and f is m-measurable on A; then again, 


cf fam= [ fam. 


Proof. (i) Let f > 0 on A. By the rules of Chapter 8, 85, [, f is always 
defined for such f; so we may set 


a). Jan, Se. 


Then by Theorem 1(f) in Chapter 8, §5, Ft on A; for a < x < y implies 


-[ sf r-Fw 


Now, by the properties of monotone limits, 


Jim F(z) = im [ i= cf” ta 


exists in E*; so by Theorem 1 of Chapter 4, §2, it can be found by making x 
run over some sequence Xp, — 00, Say, tT, =k. 
Thus set 
Ay =|o;k), B= 1,232: 


JA, = A= [a, 00), 
i.e., Ak / A, 


Moreover, by Note 4 in Chapter 8, §5, the set function s = [ f is o-additive 
and semifinite (> 0). Thus by Theorem 2 of Chapter 7, §4 (left continuity) 


(1) [ tam= jim fo f= im [ r=0 fs 


proving (i). 
of \ti= f islam 


(ii) By clause (i), 
of If] < 0 


Then {A;}7 and 


exists, as |f| > 0. Hence 
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plus measurability amounts to integrability (Theorem 2 of Chapter 8, §6). 


Moreover, 
cf Ifl<e 


implies the convergence of C fe f (see Corollary 1 below). Thus as 
lim bd 


w— Co 


exists, we proceed exactly as before (here s = [ f is finite), proving (ii) also. 


Note 2. If E C E*, formula (1) results even if f is not m-measurable.° 


Note 3. While f cannot be integrable unless | f| is (Corollary 2 of Chapter 8, 
$6), it can happen that 
C : f 


¢ | If =00 


(this is called conditional convergence). A case in point is 
& Big 
C | dx; 
0 a 


Thus C-integrals may be finite where proper integrals are co or fail to exist (a 
great advantage!). Yet they are deficient in other respects (see Problem 9(c)). 

For our next theorem, we need the previously “starred” Theorem 2 in Chap- 
ter 4, §2. (Review it!) As we shall see, C-integrals resemble infinite series. 


Theorem 2 (Cauchy criterion). Let A = [a,co), f: E' — E, E complete. 


Suppose 
/ fdm 


exists for each « € A. (This is automatic if E C E*; see Chapter 8, §5.) 


Then = 
C | i 


converges iff for every « > 0, there is b € A such that 


(2) 


converges even if 


see Problem 8. 


xz 
/ fam) <e whenever b < v < x < c0,° 
UV 


5 This is true provided La f dm is finite or orthodoz, so that s = f f is semifinite. 
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b 
/ fai < oO. 


Proof. By additivity (Chapter 8, §5, Theorem 2; Chapter 8, §7, Theorem 3), 


[r-fr+fs 


ifa<u<a<o. (Incase E C E", this holds even if f is not integrable; see 
Theorem 2, of Chapter 8, §5.) 
C | f 


Now, if 
r= lim jf din. tox. 


converges, let 


Then for any ¢ > 0, there is some 


bE |a,co) =A 


[tama 


(Why may we use the standard metric here?) 
Taking x = b, we get (2’). Also, ifa<b<vu< 2, we have 


[ fam—r 


a 1 
rf fam) < 52 


Hence by the triangle law, (2) follows also. Thus this 6 satisfies (2). 


Conversely, suppose such a b exists for every given ¢ > 0. Fixing b, we thus 
have (2) and (2’). Now, with A = [a, oo), define F: A — E by 


F(a) = | fam 


such that 
1 
< 3f for x > b. 


Zo 
zE 
2 


and 


SO 
ioe) 


C f= lim F(@) 


° Here and later, for LS integrals, replace {,” by ee and f,” by Se,a}" 
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if this limit exists. By (2), 


[tan] < [sam +] raml <| [pam] +e 


if x > b. Thus F is finite on [b,oo), and so we may again use the standard 
if x,v > b. The existence of 


metric 
[ tam- | fam) <| f° fam| <e 


C fdm= lim F(z) 4 co 


a 


|F(x)| = 


(F(x), Fv) = |F(@) — F(v)| = 


now follows by Theorem 2 of Chapter 4, §2. (We shall henceforth presuppose 
this “starred” theorem.) 


Thus all is proved. 


Corollary 1. Under the same assumptions as in Theorem 2, the conver- 


gence of 
c | |fldm 
c | f dm. 


fas fu 


(Theorem 1(g) of Chapter 8, §5, and Problem 10 in Chapter 8, §7). 
Note 4. We say that C / f converges absolutely iff C [ |f| converges. 


implies that of 


Indeed, 


Corollary 2 (comparison test). Jf |f| < |g| ae. on A = [a,oo) for some 


f,g: E' = E, then = 
cf wise f tal 


cf ial 
cf itl 


For as |f|, |g] > 0, Theorem 1 reduces all to Theorem 1(c) of Chapter 8, §5. 


so the convergence of 


implies that of 
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Note 5. As we see, absolutely convergent C-integrals coincide with proper 
(finite) Lebesgue integrals of nonnegative or m-measurable maps. For condi- 
tional (i.e., nonabsolute) convergence, see Problems 6-9, 13, and 14. 


Iterated C-Integrals. Let the product space X x Y of Chapter 8, §8 be 
E! x E! = E’, 


and let p = m x n, where m and n are Lebesgue measure or LS measures in 
BY. Let 
A= [a,b], B = [c,d], and D= Ax B. 


[ [ teman= ff tevaman 
[ [samen 


[Pf sesame) ancy 


As usual, we write “dx” for “dm(x)” if m is Lebesgue measure in E?; similarly 
for n. 


Then the integral 


is also written 


or 


We now define 


a i fdndm = Jim [ (jim. a f(x,y) in(y)) dm(x) 
=c ff se.uyanty) dco), 


provided the limits and integrals involved exist. 


(3) 


If the integral (3) is finite, we say that it converges. Again, convergence 
is absolute if it holds also with f replaced by |f|, and conditional otherwise. 
Similar definitions apply to 


lore) foe) b lee) 
oy / f dmdn, cf / f dndm, etc. 


Theorem 3. Let f: E? — E* be p-measurable on E? (p,m,n as above). Then 
we have the following. 


(i*) The Cauchy integrals 


cf f- itldnam mac ff \flaman 
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[ isle. 


(ii*) If one of these three integrals is finite, then 


cf a fdndm and C | ‘l fdmdn 


converge, and both equal 
| Ff dp. 
E2 


(Similarly for Cf fin f dndm, etc.) 


exist (< co), and both equal 


Proof. As m and n are o-finite (finite on intervals!), f surely has o-finite 
support. 


As |f| > 0, clause (i*) easily follows from our present Theorem 1(i) and 
Theorem 3(i) of Chapter 8, §8. 
Similarly, clause (ii*) follows from Theorem 3(ii) of the same section. 


Theorem 4 (passage to polars). Let p = Lebesgue measure in E?. Suppose 
f: E? — E* is p-measurable on E?. Set 


F(r,0) = f(rcos@,rsin0), r>0. 
Then 


lee) lee) ioe) 20 
(a) c| / fdedy=c | rdr f F do, and 
—oo J —0o 0 0 
co poo lore) m/2 
(b) cf | fdedy =c | rdr f F do, 
0 0 0 0 


provided f is nonnegative or p-integrable on E? (for (a)) or on (0,00) x (0,00) 
(for (b))." 


Proof Outline. First let f = Cp, with D a “curved rectangle” 
{(7,9)|r1<r<rea, 64 << Oo} 


for some r1 < rg in X = (0,00) and 0; < 02 in Y = (0,27). By elementary 
geometry (or calculus), the area 


1 
pD = 5(r2 —11)(82 — 91) 
(the difference between two circular sectors). 


” Hence the integrals in (a) and (b) can also be treated as proper integrals. 
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For f = Cp, formulas (a) and (b) easily follow from 
pD =L | C D dp. 
E2 
(Verify!) Now, curved rectangles behave like half-open intervals 


(ri, rp] x (01, 62] 


in E?, since Theorem 1 in Chapter 7, §1, and Lemma 2 of Chapter 7, §2, apply 
with the same proof. Thus they form a semiring generating the Borel field 
in E?. 

Hence show (as in Chapter 8, §8) that Theorem 4 holds for f = Cp (D € B). 
Then take D € M*. Next let f be elementary and nonnegative, and so on, as 
in Theorems 2 and 3 in Chapter 8, 88. 


Examples (continued). 


(D) Let 

j= | e-® da; 

0 
so 
J? = (cf e® i) (cf ev iy) 
0 0 
= cf | eo (@+9") da dy. (Why?) 
a. 2a 

Set 


fanaee 
in Theorem 4(b). Then F'(r, @) = e-: hence 


poof rar ( [°° a) 
0 0 


= of re dr - es tient 
: 2 4 


prem dr 


by substituting r? = t.) Thus 


(Here we computed 


a 2 = 2 1 1 
(4) c | e* de= L| e* dx =4/-1 ==y/7. 
0 0 
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Problems on Cauchy Integrals 


. Fill in all proof details in Theorems 1-3. Verify also at least some of the 


cases other than fe f. Check the validity for LS-integrals (footnote 6). 


. Prove Theorem 4 in detail. 
. Verify Notes 2 and 3 and examples (A)—(D). 


. Assuming a > 0, verify the following: 


aan | me 1 
(i) / =e" di =< 7 e 'dt=-. 
1 ¢t 1 e 


[Hint: Use Corollary 2.] 


4 —at _: _ 
ww | € Se SC 


. Verify the following: 


ar ae 1 
(i) | / 6 dole = i —e~* dx < — (converges, by 3(i)). 
1 1 1 & e 


Co CO CO CO Co 1 
(ii) | | e Y dydx > | | e Y dydx = —(l-e"*) dz > 
00, ‘ 1 JO 1 
| (<-e*) dx = o. 
4c 


Does this contradict formula (4) in the text, or Problem 5, which follows? 


. Let f(x,y) = e~*¥ and 


1 
g(a) =L [ay 
0 
so g(0) = 1. (Why?) 
(i) Is g R-integrable on A = [0,1]? Is f soon A x A? 
(ii) Find g(x) using Corollary 1 in §1. 
(iii) Find the value of 


1 pl 1 
r | | eM ayde = Bf g 
0 Jo 0 


to within 1/10. 
[Hint: Reduce it to Problem 6(b) in §1.] 
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=>6. Let f,g: E' — E* be m-measurable on A = [a,b), b < oo. Prove the 
following: 


(i) If 


b- b- 
C fF S601 C f <<, 


then C fee f exists and las 
b— 
C ft-Cc . : f dm (proper). 


(ii) If i f converges conditionally only, then 


i Za a fee 


(iii) In case Ge |f| < co, we have 


ee 


i be b— 
Cl Gea P fac f : 


if C fe g exists site or not). 
=>7. Suppose f: E! > E* is m-integrable and sign-constant on each 


An = [Qn,4n41), n=1,2,..., 


but changes sign from A, to An+1, with 


U An 
n=1 


and {a,,}1 fixed. 
Prove that if 


[, fan] No 


C / f 
converges. 


[Hint: Use Problem 10 in Chapter 4, §13.] 


as n — oo, then 
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=>8. Let ; 
f(e) ===, f(0) =1 
Prove that es 
C d 
| f(a) de 


converges conditionally only. 
[Hints: Use Problem 7. Show that 


ofitatf wlan f fanpop aol 


=>9. (Additivity.) Given f: E1 = E (E complete) and a < b<c< o, 
suppose that 


/ ae dm ae 00 
(proper) exists for each x € [a,c). Prove the following: 


(a) Cis f and Of f converge. 
(b) If 
cf f 
b 
converges, so does 


of s-of sso fs 


(c) Countable additivity does not necessarily hold for C-integrals. 
[Hint: Use Problem 8 suitably splitting [0, co).] 


10. (Refined comparison test.) Given f,g: E! — E (E complete) and b < 
oo, prove the following: 


(i) If for some a < band ke E’," 


[fl <|kg| on [a, 6) 


b— b— 
/ |g| < oo implies |f| < oo. 


a 


then 


ii) Such a,k € E' do exist if 
(ii) 
|f(t)| 


ielg@l 


exists. 
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(iii) If this limit is not zero, then 


[icc [tice 


(Similarly in the case of an with a > —oo.) 


11. Prove that 


@ f t? dt < co iff p < —1; 
1 

1 
ai) | t? dt < oo iff p> —1, 
cui) | t? dt = 


12. Use Problems 10 and 11 to test for convergence of the following: 


Oo 43/2 dt 

(a) | 

ns oie 

ie 

) at 
of Fs 


(O.P er of degree s andr, s > r; Q £0 for t > a); 
We wt 
0 V1—t4 


1 
(e) | t? Int dt; 


(g) i, tan? ¢ dt. 
0+ 


=>13. (The Abel-Dirichlet test.) Given f,g: E' > E!, suppose that 
(a) fl, with jim f®H}=0 


(b) g is L-measurable on A = [a,oo);° and 
(c) (AK €E')(Vxe A) |LI*g| < K. 


8 And hence L-integrable on each [u, v] C A, by (c). 
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Then en be f(x) g(x) dx converges. 


[Outline: Set 
ae) = fs 


so |G| < K on A. By Lemma 2 of §1, fg is L-integrable on each [u,v] C A, and 
(Ac € [u, v]) such that 


ef t9) =|r0 [9] = [200 te - 6w)| < 2K F0W), 


(Ve >0) (AkE A) (Vu>k) |f(u)| < — 


so 


(Vu >u>k) ef fal <e. 


Now use Theorem 2. 
Now extend this to g: E! + E” (C”).] 


=>14. Do Problem 13, replacing assumptions (a) and (c) by 


(a’) f is monotone and bounded on |a,oo) = A, and 
ce!) C f° g(x) dx converges. 
[Hint: If fT, say, set q = jim, f(t) and F = q— f; so 
f9=49 — Fo. 
Apply Problem 13 to 


ofr F(a) g(a) da] 


15. Use Problems 13 and 14 to test the convergence of the following: 


@) | t? sin t dt. 
0 


[Hint: The integral converges iff p < 0.] 


o+ vet 


Vv 
t 
[Hint: Integrate : ee dt by parts; then let u — 0 and v = oo] 


u vt 
(c) [ cost 4 
1 eo 


@ | sin t? dt. 
0 


[Hint: Substitute ¢? = u; then use (a).] 
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16. The Cauchy principal value (CPV) of C tee t) dt is defined by 


(CPV) _ = lim fe ) dt 


wL— CO 


(if it exists). Prove the following: 


) If Cf f(t) dt exists, so does (CPV) { f, and the two are equal. 
Disprove the converse. 
[Hint: Take f(t) = sign(t)//J¢[.] 


(ii) Do the same for 


con fam (f" 7+ ff) 


p being the only singularity in (a, b). 
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I. We now consider C-integrals of the form 
cf Ft,u)admte), 


where m is Lebesgue or LS measure in E!. Here the variable u, called a param- 
eter, remains fired in the process of integration; but the end result depends on 
u, of course. 

We assume f: E? — E (E complete) even if not stated explicitly. As before, 
we give our definitions and theorems for the case 


al 
The other cases (C if re, ee , etc.) are analogous; they are treated in Prob- 
lems 2 and 3. We assume 
a,b,c, £,t, U,V € E 


throughout, and write “dt” for “dm(t)” iff m is Lebesgue measure. 
If 


cf” femamt) 
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converges for each u in a set BC E',' we can define a map F: B — E by 

= of” f(t, u) dm(t) = Jim [ f(t, u) dm(t). 
This means that 


(1) (Wue B) (Ve>0) (4b>a) (Vx > b) 


[ f(t, u) dm(t) — F(u)| <e«, 


so |F'| < oo on B. 

Here b depends on both ¢ and wu (convergence is “pointwise” ). However, it 
may occur that one and the same 6 fits all u € B, so that b depends on ¢€ alone. 
We then say that 


cf f(t, u) dm(t) 


converges uniformly on B (i.e., for u € B), and write 


= of” f(t, u) dm(t) (uniformly) on B. 


Explicitly, this means that 


(2) (Ve >0) (db>a) (Vue B) Va>b) * feayanté — F(u)| <e. 


Clearly, this implies (1), but not conversely. We now obtain the following. 


Theorem 1 (Cauchy criterion). Suppose 


[fame 


exists forx >aandu€ BCE. (This is automatic if E C E*; see Chapter 8, 
§5.) 
Then 


a f(t,u) dm(t) 


converges uniformly on B iff for every e > 0, there is b > a such that 


/ “fh amo < 62 


[seo amo <0 


' This statement shall imply that [” f(t,w) dm(t) 4 too exists for x > a, u € B. 
? For LS-integrals, replace [” by Siw ai here and in the proof below. 


(3) (Vv,x € [b,co)) (Vue B) 


and 
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Proof. The necessity of (3) follows as in Theorem 2 of §3. (Verify!) 


To prove sufficiency, suppose the desired b exists for every ¢ > 0. Then for 
each (fixed) u € B, 


cf f(t, u) dm(t) 


satisfies Theorem 2 of §3. Hence 


(4) F(u) = lim . f(t, u) dm(t) 4 +00 


xr OO 


exists for every u € B (pointwise). Now, from (3), writing briefly [ f for 


J f(t,u) dm(t), we obtain 
ae [r- false 


for alluc€ Bandalla>vu> b. 
Making x — co (with u and v temporarily fixed), we have by (4) that 


(5) rw - fo s]<e 
whenever v > b. 


But by our assumption, b depends on ¢ alone (not on u). Thus unfixing u, 
we see that (5) establishes the uniform convergence of 


[st 


Corollary 1. Under the assumptions of Theorem 1, 


cf f(t,u) dm(t) 


as required.? 


converges uniformly on B if 


of ist amie 


does. 
Indeed, 


[ails tice 


3 Note that Theorem 1 essentially depends on the assumed completeness of E. 
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Corollary 2 (comparison test). Let f: E? - E and M: E? = E* satisfy 
[f(t,u)| < M(t, u) 


foru€ BCE! andt>a. 
Then 


of iste ame 


converges uniformly on B if 


of” M(t, u) dm(t) 


does. 


Indeed, Theorem 1 applies, with 


/ f | < / M <e. 

Hence we have the following corollary. 

Corollary 3 (“M-test”). Let f: E? = E and M: E' > E* satisfy 
[f(t u)| < M(t) 


foru€ BCE! andt>a. Suppose 


C / ” M(t) dm(t) 


converges. Then 
cf |Flt.ulam(e 


converges (uniformly) on B. So does 


ef” f(t, u) dm(t) 


by Corollary 1. 


Proof. Set 
A(t,u) = M(t) 2 |f(t,u)|. 


Then Corollary 2 applies (with M replaced by h there). Indeed, the conver- 


gence of 
cfr=ofm 


is trivially “uniform” for u € B, since M does not depend on wu at all. 
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Note 1. Observe also that, if h(t,u) does not depend on u, then the (point- 
wise) and (uniform) convergence of C fh are trivially equivalent. 
We also have the following result. 


Corollary 4. Suppose 
cf f(t, u) dm(t) 


converges (pointwise) on B C E'. Then this convergence is uniform iff 


CO 


lim C f(t,u) dm(t) = 0 (uniformly) on B, 


10.04 


(Ve >0) (Ab>a) Vue B) (Vu>b) lef Heuyam nf<e 


The proof (based on Theorem 1) is left to the reader, along with that of the 
following corollary. 


Corollary 5. Suppose 


b 
| OG eet 


exists for eachu€ BC E'. 
Then 


cf f(t, u) dm(t) 


converges (uniformly) on B iff 


cf PEA aae 


does. 


II. The Abel-Dirichlet tests for uniform convergence of series (Problems 9 
and 11 in Chapter 4, §13) have various analogues for C-integrals. We give two 
of them, using the second law of the mean (Corollary 5 in §1). 

First, however, we generalize our definitions, “unstarring” some ideas of 
Chapter 4, 811. Specifically, given 


H: E* — E (E complete), 


we say that H(x,y) converges to F(y), uniformly on B, as « — q (q € E*), 
and write 
lim H(x,y) = F(y) (uniformly) on B 


w—-q 
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iff we have 


(6) (We >0) (AG-q) Wy € B) (VaEeGig) |H(2,y)- FY) <6 


hence |F| < co on B. 
If here g = ov, the deleted globe G_, has the form (b, co). Thus if 


Ag) = [ f(t, u) dt, 


(6) turns into (2) as a special case. If (6) holds with “(4G_,)” and “(Vy € B)” 
interchanged, as in (1), convergence is pointwise only. 

As in Chapter 8, 88, we denote by f(-,y), or f¥, the function of x alone 
(on E*) given by 


f*(@) = f(@,y). 
Similarly, 
f(y) — Tae). 


Of course, we may replace f(x,y) by f(t,u) or H(t, wu), ete. 
We use Lebesgue measure in Theorems 2 and 3 below. 


Theorem 2. Assume f,g: E? — E' satisfy 
(i) Cf g(t, u) dt converges (uniformly) on B; 
(ii) each g” (u € B) is L-measurable on A = [a, oo); 
(iii) each f% (u € B) is monotone (| or t) on A;* and 
(iv) |f| <.K € E' (bounded) on A x B. 
Then = 
C / Fecal ai at 


converges uniformly on B. 


Proof. Given ¢ > 0, use assumption (i) and Theorem 1 to choose b > a so that 


: E 


written briefly as 


for allu € Band x > v > b, with K as in (iv). 


4 Briefly: “f(t,u) is monotone in t, and g(t,u) is measurable in t (t € A).” It should be 
well noted that all f“ and g” are functions of t on E!. 
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Hence by (ii), each g"” (u € B) is L-integrable on any interval |[v,z] C A, 
with « > v > b. Thus given such wu and |v, x], we can use (iii) and Corollary 5 
from §1 to find that 


bf pe =poe forrest fo 


for some c € |v, 2]. 
Combining with (7) and using (iv), we easily obtain 


ef f(t, u) g(t, u) dt] <e 


whenever u € B and x > v > b. (Verify!) 
Our assertion now follows by Theorem 1. 
Theorem 3 (Abel-Dirichlet test). Let f,g: E? + E* satisfy 
(a) jim f(t,u) =0 (uniformly) for u € B; 


(b) each f“ (u € B) is nonincreasing (|) on A = [0, co); 

(c) each g“ (u € B) is L-measurable on A; and 

(d) (AK € E') (Vae A) (Vue B) |L J g(t,u)dt| < K. 
Then 


cf f(t, u) g(t, u) dt 


converges uniformly on B. 


Proof Outline. Argue as in Problem 13 of 83, replacing Theorem 2 in §3 by 
Theorem 1 of the present section. 
By Lemma 2 in §1, obtain 


tf re 


foru€ Bandg>v>a. 
Then use assumption (a) to fix k so that 


If(t,u)| < 


< K f(v,u) 


rot fo" 


a 
2K 


fort >kandue€ B. 


Note 2. Via components, Theorems 2 and 3 extend to the case g: E? > 
EMG"), 

Note 3. While Corollaries 2 and 3 apply to absolute convergence only, 
Theorems 2 and 3 cover conditional convergence, too (a great advantage!). The 


theorems also apply if f or g is independent of u (see Note 1). This supersedes 
Problems 13 and 14 in 83. 
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Examples. 


(A) 


The integral 


© sin tu 
| dt 
0 t 


converges uniformly on Bs = [6,0o) if d > 0, and pointwise on B = [0, 00). 
Indeed, we can use Theorem 3, with 


g(t, u) = sintu 
and 


f(t.) ==, £0,u) =1, 


say. Then the limit 


is trivially uniform for u € Bs, as f is independent of u. Thus assumption 
(a) is satisfied. So is (d) because 


[ sintuat) =|= | sind d6| < 52 
) U JO 3 


(Explain!) The rest is easy. 


Note that Theorem 2 fails here since assumption (i) is not satisfied. 


eo '1 
| ~e—™ sin at dt 
o t 


converges uniformly on B = [0,0o). It does so absolutely on Bs = [6, 00), 
ifd > 0. 
Here we shall use Theorem 2 (though Theorem 3 works, too). Set 


The integral 


fie" 
and 
g(t, 2) = = g(0; uu) =a. 
Then 


[ae dt 


converges (substitute x = at in Problem 8 or 15 in §3). Convergence is 
trivially uniform, by Note 1. Thus assumption (i) holds, and so do the 
other assumptions. Hence the result. 

For absolute convergence on Bs, use Corollary 3 with 


M(t) =e-*, 
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so M > |fgl. 
Note that, quite similarly, one treats C-integrals of the form 


/ et g(t)at, f e “9(t) dt, etc., 


[ dt 


In fact, Theorem 2 states (roughly) that the uniform convergence of 
C { g implies that of C J fg, provided f is monotone (in t) and bounded. 


provided 


converges (a > 0). 


III. We conclude with some theorems on uniform convergence of functions 
H: E* = E (see (6)). In Theorem 4, m is again an LS (or Lebesgue) measure 
in E'; the deleted globe G®, is fixed. 


Theorem 4. Suppose 
lim H(x2,y) = F(y) (uniformly)? 
@2—q 
fory€ BCE!. Then we have the following: 
(i) If all H, (x € G*,) are continuous® or m-measurable on B, so also is F. 
(ii) The same applies to m-integrability on B, provided mB < ov; and then 
(8) lim | |H, — F| =0; 


hence 


(8’) lin fH, =| =| ( (lim H,) 
@2—q @r—q 


Formula (8’) is known as the rule of passage to the limit under the integral 
sign. 


Proof. (i) Fix a sequence x, — q (a, in the deleted globe G*,), and set 
Pip = Fine le = WD e 
The uniform convergence 


Hey) > Fy) 


5 Pointwise or a.e. convergence suffices for m-measurability in clause (i). 
6 Here and in Theorem 5, as functions of y: Hz(y) = H(a2,y). Continuity may be relative 
or uniform. 
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is preserved as x runs over that sequence (see Problem 4). Hence if all Hj, are 
continuous or measurable, so is F’ (Theorem 2 in Chapter 4, §12 and Theorem 4 
in Chapter 8, §1). Thus clause (i) is proved. 

(ii) Now let all H, be m-integrable on B; let 


mB <o. 


Then the Hj; are m-measurable on B, and so is F’,, by (i). Also, by (6), 


(We >0) (AG) (Wx € Gy) | \e- Fis [ @=emB <0, 


proving (8). Moreover, as 


| \te-Fl< 0, 
B 


H, — F is m-integrable on B, and so is 


F =H, —(H, — F). 


[te- [r|=|fae-7|s fim Fino, 


as x — q, by (8). Thus (8’) is proved, too. 


Hence 


Quite similarly (keeping EF complete and using sequences), we obtain the 
following result. 


Theorem 5. Suppose that 


(i) all Hy (« € G*,) are continuous and finite on a finite interval B C E', 
and differentiable on B — Q, for a fixed countable set Q; 


(ii) lim H(z, yo) # +00 exists for some yo € B; and 
«@Z—q 

(iii) lim D2.H (x,y) = f(y) (uniformly) exists on B— Q. 
@=—q 


Then f, so defined, has a primitive F on B, exact on B—Q (so F’ = f on 
B—Q); moreover, 


F(y) = lim A(a,y) (uniformly) for y € B. 
wy 
Outline of proof. Note that 
d 
— H,(y). 
7 (y) 
Use Theorem 1 of Chapter 5, §9, with FF, = Hz, tn — ¢. 


D2H (x,y) = 


Note 4. If « — q over a path P (clustering at q), one must replace G_, 
and G*, by POG, and PM G*, in (6) and in Theorems 4 and 5. 


A12 


1’. 
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Problems on Uniform Convergence 
of Functions and C-Integrals 


. Fill in all proof details in Theorems 1—5, Corollaries 4 and 5, and exam- 


ples (A) and (B). 

Using (6), prove that 
lim H(x,y) (uniformly) 
@—q 


exists on B C E! iff 


(Ve > 0) (AG_,) Vy€ B) (Va,2'€ G_,) |H(x,y)— H(2’,y)| <e. 


Assume £ complete and |H| < co on G_, x B. 
[Hint: “Imitate” the proof of Theorem 1, using Theorem 2 of Chapter 4, §2.] 


. State formulas analogous to (1) and (2) for ["_., Ls and ie 


. State and prove Theorems 1 to 3 and Corollaries 1 to 3 for 


a b— b 
/ : / , and / . 
—oo a a+ 
In Theorems 2 and 3 explore absolute convergence for 
b- b 
/ and | ; 
a a+ 


Do at least some of the cases involved. 
[Hint: Use Theorem 1 of §3 and Problem 1’, if already solved.] 


. Prove that 


lim A(x, y) = F(y) (uniformly) 
xL—q 
on B iff 
lim H(2n,-) = F (uniformly) 
on B for all sequences rn — q (fn # Q). 
[Hint: “Imitate” Theorem 1 in Chapter 4, §2. Use Definition 1 of Chapter 4, §12.] 


. Prove that if 


lim H(x,y) = F(y) (uniformly) 


«w—7q 


on A and on B, then this convergence holds on AU B. Hence deduce 
similar propositions on C-integrals. 


. Show that the integrals listed below violate Corollary 4 and hence do not 


converge uniformly on P = (0,6)" though proper L-integrals exist for 


’ Here and below, 6 > 0 is arbitrarily small. 
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each u € P. Thus show that Theorem 1(ii) does not apply to uniform 
convergence. 


db pice? 
0) f arpa tt 
(c) [ tu(t® —u") 


(P+ wy 


[Hint for (b): To disprove uniform convergence, fix any €,v > 0. Then 


a u2 — t? Vv 1 
dt = > 
0 (t? + u2)? y2 + U2 Vv 


as u— 0. Thus ifv < x, 


va? —t? 1 
due P dt > > €. 
ie ) i, (t? + u2)? Qu Fl 


7. Using Corollaries 3 to 5, show that the following integrals converge (uni- 
formly) on U (as listed) but only pointwise on P (for the latter, proceed 
as in Problem 6). Specify P and M(t) in each case where they are not 
given. 


(a) i e~“”” dt; U = (6,00); P = (0,4). 


(Hint: Set M(t) = e~°** for t > 1 (Corollaries 3 and 5).] 


(b) [ e“* t* cost dt (a > 0); U = [6, 00). 
0 
(c) is fet dts = [6,60): 


(ey ‘l t*—1 (In t)" dt; U = [6, 00). 


1 
(d) i t-“sint dt; U = [0,6], 0 <6 <2; P= (6,2); M(t) =t!-°. 


[Hint: Fix v so small that 


sin t 1 
Vt € (0, ae SS 
(Vee (0,0) S>> 


2 1 (” dt 
i t—“ sint dt > ah = oo.] 
0 2 0 fu-l 


Then, if u — 2, 
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10. 


11. 


12. 


13. 


=>14. 
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. In example (A), disprove uniform convergence on P = (0,00). 


[Hint: Proceed as in Problem 6.] 


. Do example (B) using Theorem 3 and Corollary 5. Disprove uniform 


convergence on B. 


Show that 


© sin tu 
cost dt 
o+ € 


converges uniformly on any closed interval U, with +1 ¢ U. 
[Hint: Transform into 


Py ay t - sin| (uw 
5 [ Ksinl(u + a)e + snl — De} a 


Show that me 
i t sint? sin tu dt 
0 


converges (uniformly) on any finite interval U. 
[Hint: Integrate 


- 3 
i t sint? sin tu dt 
x 


by parts twice. Then let y > oo and x — 0.] 


Show that 


[o-e) 
t 
i eS at (Oa) 
te 
O+ 


converges (uniformly) for u > 0. 
[Hints: For t s 0+, use M(t) =t~°. For t — oo, use example (B) and Theorem 2.] 


Prove that 
sid t 
ir ae dt (<o7%<.1) 
o+ + 


converges (uniformly) for u > 6 > 0, but (pointwise) for u > 0. 
[Hint: Use Theorem 3 with g(t, u) = costu and 


fs 
0 


© costu = © cos z 
/ . dt = u%—! dz — co 
Vv t VU z 


if v = 1/u and u — 0. Use Corollary 4.] 
Given A,B C E! (mA < oo) and f: E? = E, suppose that 


(i) each f(a,-) = fe (a € A) is relatively (or uniformly) continuous 
on B; and 


(ii) each f(-,y) = f¥ (y € B) is m-integrable on A. 


| sin cu | 


U 


For u > 0, 
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=>15. 


Set 
Fu) = | fendm(e), yeB. 


Then show that F is relatively (or uniformly) continuous on B. 
[Hint: We have 


(Va € A) (Ve > 0) (Vyo € B) (46 > 0) (Vy € BN Gy (0)) 
E: 


IF(y) — F(yo)| < f lfle.w) - Fle.wolam(e) < ff (<5) dm =e. 


Similarly for uniform continuity.] 

Suppose that 
(a) C f-* f(t, y) dm(t) = F(y) (uniformly) on B = [b, d| C E'; 
(b) each f(x, -) = fx (@ => a) is relatively continuous on B; and 


(c) each f(-,y) = f¥ (y € B) is m-integrable on every [a,2] C E', 
u> a. 


Then show that F' is relatively continuous, hence integrable, on B and 
that 
| F= lim Ay, 
B wr CoO B 


H(e.y) = [flew din) 


where 


(Passage to the limit under the f[-sign.) 
[Hint: Use Problem 14 and Theorem 4; note that 


of f(t, y) dm(t) = im, A (x,y) (uniformly).] 
0) 


Index 


Abel-Dirichlet test 
for convergence of improper integrals, 
400 
for uniform convergence of parametrized 
C-integrals, 408 
Absolute 
extrema, 82 
maxima, 82 
minima, 82 
Absolute continuity of the integral, 275 
Absolute convergence of improper inte- 
grals, 393 
Absolutely continuous functions on E!, 
378 
and L-integrals, 380 
Absolutely continuous with respect to a set 
function t, 197 
Additive extensions of set functions, 129 
Additive set functions, 126, 126 
Additivity of the integral, 260, 290 
Additivity of volume 
countable, 104 
of intervals, 101 
o-additivity, 104 
Almost everywhere (a.e.), 231 
convergence of functions, 231 
Almost measurable functions, 231, 231 
Almost uniform convergence of functions, 
239 
Egorov’s theorem, 240, 283 
Antiderivatives, 357 
and L-integrals, 357 
and R-integrals, 362 
change of variable in, 363 
primitives, 359 


Baire categories (of sets), 70 
sets of Category I, 71 
sets of Category II, 71 
Baire’s theorem, 71 
Banach spaces. 76 


integration of functions with values in, 
285-291, 305 
open map principle, 75 
uniform boundedness principle, 75 
Banach-Steinhaus uniform boundedness 
principle, 75 
Basic covering of a set, 138 
Basic covering value of a set, 138 
Basis of a vector space, 16 
Bicontinuous maps, 70 
Bijective 
functions, 52 
linear maps, 53 
Borel 
fields, 162 
measurable functions, 222 
measures, 162 
restrictions of measures, 162 
sets, 162 


Boundedness, linear, 9 


C,-sets, 104 
volume of, 107 
C-simple sets, 99 
C!, family of C-simple sets, 99 
C-integrals, see Improper integrals 
parametrized, 402; see also Parametrized 
C-integrals 
Cantor’s set, 76 
Carathéodory property (CP), 145, 146, 157 
Cauchy criterion 
for convergence of improper integrals, 
391 
for uniform convergence of parametrized 
C-integrals, 403 
Cauchy integrals (C-integrals), see Im- 
proper integrals 
parametrized, 402; see also Parametrized 
C-integrals 
Cauchy principal value (CPV). 402 
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Chain rule 
classical notation for, 31 
for differentiable functions, 28 
on E” and C”, 30 
Change of measure in generalized integrals, 
332 
Change of variable 
in antiderivatives, 363 
in Lebesgue integration, 386 
Characteristic functions, 246 
Clopen maps, 61 
Closed maps, 59 
Closed sets in topologies, 161 
Compact regular (CR) set functions on 
topological spaces, 209 
Comparison test 
for improper integrals, 393, 399 
for uniform convergence of parametrized 
C-integrals,405 
Complete measures, 148 
Complete normed spaces, see Banach 
spaces 
Completions of measures, 159 
completions of generalized measures, 205 
Completely additive set functions, see o- 
additive set functions 
Continuous 
functions between topological spaces, 
161 
linear map, 13 
set functions, 131, 147 
with respect to a set function t (t- 
continuous), 197 
Continously differentiable functions, 38, 57 
Convergence of functions 
almost everywhere, 231 
almost uniform, 239 
Egorov’s theorem, 240, 283 
in measure, 239, 280 
Lebesgue’s theorem, 240, 283 
Riesz’ theorem, 280 
Convergence of improper integrals, 388 
absolute, 393 
Cauchy criterion for, 391 
comparison test for, 393, 399 
conditional, 391 
Abel-Dirichlet test for, 400 
Convergent sequences of sets, 180 
Countably-additive set functions, see o- 
additive set functions 
Coverings of sets. 137 


Index 


basic, 138 

M-coverings of a set, 137 

Q-coverings of a set, 213 

Vitali, 180; see also Vitali coverings 
CP, the Carathéodory property, 145 
Critical points, 82 


Darboux sums (upper and lower), 307 
Decompositions 

Lebesgue, 342 

of generalized measures, 344 
Derivates 

of point functions, 373 

of set functions (D(p), D(p)), 187 
Derivatives 

directional, see Directional derivatives 

of set functions, 210 

Radon-—Nikodym, 338, 351 

partial, see Partial derivatives 
Determinants 

functional, 49 

of matrices, 47, 96 
Differentiable functions, 17 

and directional derivatives, 19 

chain rule for, 28 

continuously, 38, 57 

differentials of, 17 

and partial derivatives, 19, 22 

in a normed space, 17 

m times differentiable, 38 
Differentiable set functions, 210 
Differentials, 17 

chain rule for, 28 

of functions in a normed space, 17 

of order m, 39 
Differentiation of set functions, 210-216 

K-differentiation, 211 

Lebesgue differentiation, 211, 351 

Q-differentiation, 211, 353 
Directional derivatives, 1 

differentiable functions and, 19 

Finite Increments Law for, 7 

higher order, 35 

of linear maps, 15 
Discriminant of a quadratic polynomial, 80 
Disjoint set families, 99 
Dominated convergence theorem, 273, 327 
Dot products, linear functionals on LE” and 

C” as, 10 

Double series, 110, 115 


Index 


BE™ 
intervals in, 97 
volume of open sets in, 108 
Elementary functions, 218 
integrable, 241 
integrals of, 241 
integration of, 241—250 
Euler’s theorem for homogeneous func- 
tions, 34 
Extended-real functions 


integration of, 251-267; see also Integra- 


tion of extended-real functions 

integrable, 252 

lower integrals of, 251 

upper integrals of, 251 

Extremum, extrema 

absolute, 82 

conditional, 88 

local, 79, 89 


Fatou’s lemma, 272 
Fields of sets, 116 
generated by a set family, 117 
Finite Increments Law for directional 
derivatives 7 
Finite set functions, 125 
Finite with respect to a set function t (t- 
finite), 197 
Finitely additive set functions, 126, 126 
Fréchet’s theorem, 237 
Fubini 
map, 294 
theorem, 298, 301, 305, 334 
Functional determinants, 49 
Functionals, linear, see Linear functionals 
Functions. See also Maps 
bijective, 52 
continuous, 161 
differentiable, see Differentiable func- 
tions 
homeomorphisms, 70 
homogeneous, 34 
implicit function theorem, 64 
inverse function theorem, 61 
partially derived, 2 
Fundamental theorem of calculus, 360 


Generalized integration, 323ff. 
change of measure, 332 
dominated convergence theorem, 327 
Fubini property in, 334 
indefinite integrals in, 330 
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Generalized measure spaces, 194 
integration in, 323ff. 
Generalized measures, 194 
completion of, 205 
decomposition of, 344 
signed measures, 194, 199 
Gradient of a function, 20 


Hadamard’s theorem, 96 

Hahn decomposition theorem, 201 
Hereditary set families, 123 
Homeomorphisms, 70 


Homogeneous functions, 34 
Euler’s theorem for, 34 


Implicit 
differentiation, 66, 87 
function theorem, 64 
Improper integrals, 388 
absolute convergence of, 393 
Cauchy criterion for, 391 
Cauchy principal value (CPV) of, 402 
comparison test for, 393, 399 
conditional convergence of, 391 
Abel—Dirichelet test for convergence of, 
400 
iterated, 394 
convergence of, 388 
singularities of, 387 
Indefinite integrals, 263, 293, 330 
indefinite L-integrals, 366 
Independence, linear, 16 
Inner products representing linear func- 
tionals on E£” and C”, 10 
Integrable functions 
elementary, 241 
extended-real, 252 
with values in complete normed spaces, 
285 
Riemann, 307, 317 
Integrals 
Cauchy (C-integrals), 388; see also Im- 
proper integrals 
in generalized measure spaces, 323ff. 
indefinite, 263, 293, 330 
improper, 388; see also Improper inte- 
grals 
iterated, 294 
Lebesgue, 357 
Lebesgue integrals and Riemann inte- 
grals, 313 
lower, 251 
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of elementary functions, 241 
orthodox, 247 
parametrized C-integrals, 402; see also 
Parametrized C-integrals 
Riemann (R-integrals), 308ff.; see also 
Riemann integrals 
Riemann-Stieltjes, 318 
Stieltjes, 319, 321ff. 
unorthodox, 247 
upper, 251 
with respect to Lebesgue measure (L- 
integrals), 357 
Integration 
absolute continuity of the integral, 275 
additivity of the integral, 260, 290 
by parts, 321 
dominated convergence theorem, 273, 
327 
Fatou’s lemma, 272 
in generalized measure spaces, 323ff. 
of elementary functions, 241—250 
of extended-real functions, 251-267 
of functions with values in Banach 
spaces, 285-291, 305 
linearity of the integral, 267, 288 
monotone convergence theorem, 271 
weighted law of the mean, 269 
Intervals in FE”, 97 
additivity of volume of, 101 
simple step functions on, 218 
step functions on, 218 
Inverse function theorem, 61 
Iterated integrals, 294 
iterated improper integrals, 394 
Fubini map, 294 
Fubini theorem, 298, 301, 305, 334 


Jacobian matrix, 18 

Jacobians, 49 

Jordan components, 203 

Jordan decompositions, 202 
Jordan components, 203 

Jordan outer content, 140 


K (the set of all cubes in E”), 186, 210 


L-measurable, see Lebesgue-measurable. 
L-integrable, see Lebesgue-integrable. 
L-integrals, 357 


and absolutely continuous functions, 380 


indefinite, 366 
L-primitive. 366 


Index 


Lagrange form of the remainder in Taylor’s 


Theorem, 42 
Lagrange multipliers, 89 
Lebesgue 
decompositions, 342 
extensions, 154, 168 
Lebesgue-integrable functions, 241 
Lebesgue-measurable functions, 222 
Lebesgue-measurable sets, 168 
measure, 168-175 
outer measure, 138 
nonmeasurable sets under Lebesgue 
measure, 173 
points of functions, 382 
premeasure, 126, 138, 168 
premeasure space, 138 
sets of functions, 382 
Lebesgues-Stieltjes 
measurable functions, 222 
measures, 176 
measures in E”, 179 
outer measures, 146, 176 
premeasures, 176 
set functions, 127, 135, 176 
signed Lebesgues—Stieltjes measures, 
206, 335 
Linear boundededness, 9 
Left-continuous set functions, 131 
Linear functionals, 7 
on &” and C” as dot products, 10 
Linear maps, 7 
as a normed linear space, 13 
bijective, 53 
bounded, 9 
continuous, 9, 13 
directional derivatives of, 15 
matrix representation of composite, 12 
matrix representation of, 11 
norm of, 13 
uniformly continuous on £” or C”, 10 
Linear subspaces of a vector space, 16 
Linear independence, 16 
Linearity of the integral 
of extended-real functions, 267 
of functions with values in Banach 
spaces, 288 
Lipschitz condition, 25, 384 
Local 
extremum, extrema, 79, 89 
maximum, maxima, 79 
minimum, minimima, 79 


Index 


Lower 

Darboux sums, 307 

integrals, 251 

Riemann integrals, 308 
LS, see Lebesgues-—Stieltjes. 
Luzin’s theorem, 234 


M-test for uniform convergence of param- 
etrized C-integrals, 405 
Maps. See also Functions 
bicontinuous, 70 
clopen, 61 
closed, 59 
linear, see Linear maps 
open, 59 
open map principle, 75 
Matrix, matrices 
as elements of a vector space, 15 
determinants of, 47, 96 
Jacobian, 18 
nm Xn matrices as a noncommutative ring 
with identity, 15 
of composite linear maps, 12 
representation of a linear map, 11 
Maximum, maxima 
absolute, 82 
conditional, 88 
local, 79 
Meagre sets, 71 
Measurable covers of sets, 156 
Measurable functions 
almost, 231 
Borel, 222 
Fréchet’s theorem, 237 
Lebesgue (L), 222 
Lebesgues-Stieltjes (LS), 222 
Luzin’s theorem, 234 
M-measurable functions, 218 
m-measurable functions, 231 
Tietze’s theorem, 236 
Measurable sets, 147 
nonmeasurable sets under Lebesgue 
measure, 173 
outer, 149 
Measurable spaces, 217 
Measure spaces, 147 
almost measurable functions on sets in, 
251 
probability spaces as, 148 
topological, 162 
Measures, 147, 194. See also Set functions 
Borel restrictions of, 162 
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as extensions of premeasures, 154 
Borel, 162 
complete, 148 
completions of, 159 
constructed from outer measures, 152 
generalized, 194 
Lebesgue, 168-175 
Lebesgue extensions, 154 
Lebesgues-Stieltjes, 176 
Lebesgues-Stieltjes measures in E”, 179 
outer, 138, 139; see also Outer measures 
product, 293 
regular, 162 
rotation-invariant, 192 
signed, 194, 199 
signed Lebesgue-Stieljes, 206, 335 
strongly regular, 162 
totally o-finite, 169 
translation-invariant, 171 

Metric spaces 
as topological spaces, 161 
networks of sets in, 212 

Minimum, minima 
absolute, 82 
conditiona, 88 
local, 79 

Monotone convergence theorem, 271 


Monotone set functions, 136, 117 


Networks of sets in metric spaces, 212 


Nonmeasurable sets under Lebesgue mea- 
sure, 173 


Norm of a linear map, 13 


Normal Vitali coverings, 192 


Nowhere-dense sets, 70 


Q-coverings of a set, 213 
Q-differentiation, 211 
and Radon—Nikodym derivative, 353 
Open map principle, 75 
Open maps, 59 
Open sets 
in topologies, 161 
volume of, 108 
Operator, linear, 7 
Orthodox integrals, 247 


Outer content, 140 
Jordan, 140 


Outer measurable sets, 149 
Outer measure spaces. 149 
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Outer measures, 138, 139 
Carathéodory property (CP), 145 
constructing measures from, 152 
Lebesgue outer measure, 138, 146, 176 
Lebesgues-Stieltjes, 146 
outer measurable sets, 149 
regular, 155, 156 


P(S), the power set of S, 116 
Parametrized C-integrals, 402 
Abel-Dirichlet test for uniform conver- 
gence of, 408 
Cauchy criterion for uniform conver- 
gence of, 403 
comparison test for uniform convergence 
of, 405 
M-test for uniform convergence of, 405 
Partial derivatives, 3 
differentiable functions and, 19, 22 
higher order, 35 
Partially derived function, 2 
Partitions of sets, 195, 217 
elementary functions on, 218 
refinements of, 218, 308 
simple functions on, 218 
Permutable series, 110 
Polar coordinates, 46, 50, 55, 306, 395 
Positive series, 111 
Power set P(S), 116 
Premeasures, 137, 147 
measures as extensions of, 154 
induced outer measures from, 138 
Lebesgue, 126, 138, 168 
Lebesgues-Stieltjes, 176 
Premeasure spaces, 138 
Lebesgue, 138 
Primitives, see Antiderivatives 
Probability spaces, 148 
Product measures, 293 
Products of set families, 120 
Pseudometric spaces, 165 
Pseudometrics, 165 


Quadratic forms, symmetric, 80 


R-integrals, see Riemann integrals 
Radon—Nikodym derivatives, 338 

and Lebesgue differentiation, 351 

and ()-differentiation, 353 
Radon—Nikodym theorem, 338 
Refinements of partitions of sets. 218. 308 
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Regular measures, 162 
Regular set functions, 140 

compact, 209 

outer measures as, 155, 156 
Regulated functions, 312 
Residual sets, 71 
Riemann-integrable functions, 307, 317 
Riemann integrals, 308ff. 

Darboux sums (lower and upper), 307 

Lebesgue integrals and, 313 

lower, 307 

regulated functions, 312 

Riemann sums, 321 

upper, 307 
Riemann sums, 321 
Riemann-Stieltjes integrals, 318 
Right-continuous set functions, 131 
Ring 

n Xn matrices as a noncommutative ring 

with identity, 15 

Rings of sets, 101, 115 

generated by a set family, 117 
Rotation-invariant measures, 192 


o-additive set functions, 126, 147 
o-additivity of volume, 104 
o-algebras of sets, 116. See also o-field 
o-fields of sets, 116 

Borel fields, 162 

genereated by a set family M, 117 
o-finite set functions, 140 

totally, 140, 169 
o-rings of sets, 116, 147 

Borel fields, 162 

generated by a semiring, 119 

generated by a set family, 117 
o-subadditive set functions, 137, 147 
o°-finiteness, 167 
Semifinite set functions, 126 
Semirings of sets, 98 
Separable sets, 223 
Series 

double, 110, 115 

permutable, 110 

positive, 111 
Sets 

Borel, 162 

Co, 104 

C-simple, 99 

Cantor’s set, 76 

convergent sequences of, 180 
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families of, see Set families 
Lebesgue-measurable, 168 
meagre, 71 

measurable, 147 
nonmeagre, 71 

nowhere dense, 70 

of Category I, 71 

of Category II, 71 

outer measurable, 149 
partitions of, 195 

residual, 71 

rings of, 101, 115 
o-algebras of, 116 

o-fields of, 116 

o-rings of, 116 

semirings of, 98 

separable, 223 

symmetric difference of, 122 
Vitali coverings of, 180 
volume of, see Volume 


Set algebras, 116. See also Set fields. 
Set families, 98 


set algebras, 116 
C-simple sets C4, 99 
disjoint, 99 
fields, 116 
hereditary, 123 
products of, 120 
rings, 101, 115 
o-algebras, 116 
o-fields, 116 
o-rings, 116 
semirings, 98 


Set fields, 116 


generated by a set family, 117 


Set functions, 125 


absolutely continuous with respect 
to a set function t (absolutely t- 
continuous), 197 

additive, 126, 137 

additive extension of, 129 

compact regular (CR) set functions on 
topological spaces, 209 

continuous, 131, 147 

continuous with respect to a set function 
t (t-continuous), 197 

derivates of (D(p), D(p)), 187 

derivatives of, 210 

differentiable, 210 

finite, 125 

finite with respect to a set function t (t- 
finite), 197 

finitely additive. 126. 126 
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generalized measures, 194 
Lebesgue premeasure, 126 
Lebesgues-Stieltjes, 127, 135, 176 
left-continuous, 131 
monotone, 136, 147 
outer measures, 138; see also Outer mea- 
sures 
premeasures, 137 
regular, 140, 155 
right-continuous, 131 
rotation-invariant, 192 
o-additive, 126 
o-finite, 140 
o-subadditive, 137 
semifinite, 126 
signed measures, 194, 199 
signed Lebesgues—Stieltjes measures, 
206, 335 
singular with respect to a set function t 
(t-singular), 341 
total variation of, 194 
totally o-finite, 140, 169 
translation-invariant, 171 
volume of sets, see Volume 
Set rings, 101, 115 
generated by a set family, 117 
Signed Lebesgues-—Stieltjes measure spaces, 
206 
induced by a function of bounded varia- 
tion, 206 
integration in, 335 
Signed measure spaces, 194, 199 
Hahn decomposition theorem, 201 
Jordan components, 203 
Jordan decompositions, 202 
negative sets in, 199 
positive sets in, 199 
Simple functions, 218 
simple step functions, 218 
Singular with respect to a set function t 
(t-singular), 341 
Singularities of improper integrals, 387 
Span of vectors in a vector space, 16 
Step functions, 218 
simple, 218 
Stieltjes integrals, 319, 321ff. 
integration by parts, 321 
laws of the mean, 322 
Strongly regular measures, 162, 234, 237, 
347 
Sylvester’s theorem, 80 
Svmmetric difference of sets. 122 
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Symmetric quadratic forms, 80 of sets, 125 
Sylvester’s theorem, 80 o-subadditivity of, 109 
Taylor polynomial, 43 Weighted law of the mean, 269 


Taylor’s Theorem, 40 
generalized, 45 
Lagrange form of remainder, 42 
Taylor polynomial, 43 
Tietze’s theorem, 236 
Topological measure spaces, 162 
Topological spaces, 161 
compact regular (CR) set functions on, 
209 
continuous functions between, 161 
metric spaces as, 161 
pseudometric spaces as, 165 
Topologies, 161 
closed sets in, 161 
open sets in, 161 
Total variation of set functions, 194 
Totally o-finite set functions, 140, 169 
Translation-invariant set functions, 171 


Uniform boundedness principle of Banach 
and Steinhaus, 75 

Uniformly normal Vitali coverings, 192 
Universal Vitali coverings, 192 
Unorthodox integrals, 247 
Upper 

Darboux sums, 307 

integrals, 251 

Riemann integrals, 307 


V-coverings, see Vitali coverings 
Vectors 
span of a set of, 16 
Vector spaces 
basis of, 16 
dimension of, 16 
linear subspaces of, 16 
matrices as elements of, 15 
span of vectors in, 16 
Vitali coverings, 180 
normal, 192 
uniformly normal, 192 
universal, 192 
Volume 
additivity of volume of intervals, 101 
monotinicity of, 109 
of C,-sets in E”, 107 
of open sets in #”. 108 
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